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CHAPTER 1 
INTRODUCTION 

Fueled by school board accountabiHty concerns, minimum competency 
mandates, evaluation requirements for federal, state and local programs, 
and the growth of curriculum-embedded and continuum-based assessment 
systems, achievement testing in American schools has become both an 
enterprise of significant scope and visibility and the subject of 
considerable public discussion and debate. Critics have attacked the 
arbitrariness of current testing practices (Baker, 1978), have expressed 
concerns about their validity and bias (Perrone, 1978), have accused 
testing of narrowing the curriculum and have questioned the value of 
traditional testing amidst changing functions of education (Tyler, 1977). 
The quality of available tests continues to be controversial (CSE, 1979; 
The Huron Institut e 1978), at least one major teachers' organization 
called for a moratorium on the use of standardized tests, and vigorous 
legal battles have been launched. 

Responding to these various challenges, advocates of testing have 
reaffirmed its importance and reasserted the variety of purposes that 
current tests can and do serve. Supporters have maintained, for example, 
that testing promotes accountability, facilitates more accurate placement 
and selection decisions, and yields Information useful for curricular and 
instructional improvement. 

The testing controversy rages on while the nation's considerable 
investment in achievement testing continues. Although the stakes in the 
debate are high, public policy in this arena has been form:ilated without 
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the benefit of basic Information about the nature of testing as it actually 
occurs and is used in schools. How much testing really goes on? How are 
test results used? What functions do tests serve for teachers and 
principals? What are the effects on schools of various local, state and 
federal manadates? These and similar questions have gone largely 
unaddressed. A few studies have indicated teachers' reservations about the 
limited use of one type of achievement measure the norm- referenced 
standardized test (Alrasian, 1979; Boyd et al , 1975; Goslin, 1965; Goslin, 
Epstein, & Halloch, 1965; Resnick, 1981; Salmon-Cox, 1978; Stetz & Beck, 
1979). Beyond this, however, the landscape oiP testing practices and test 
use in American schools remains largely unexplored. 

In this context, the UCLA Center for the Study of Evaluation's (CSE) 
three-year study provides educational policy-makers with basic, neV 
information on classroom achievement testing iicross the United States. 
Conducted from 1979 through 1983, CSE's research was designed to take a 
comprehensive picture of national testing practices. It investigated a 
wide range of types of formal assessment measures (e.g., commercially 
produced norm- and criterion-referenced tests and curriculum embedded 
measures, tests of minimum competency and functional literacy; district-, 
school-, and teacher-developed tests) as well as some less formal means for 
gauging student progress jind achievement (teachers' observations of and 
interactions with learners). Within this broad range. Inquiry focused on 
achievement testing practices in reading/English and in mathematics, basic 
skills areas which are the subject of continuing public concern. Teachers 
and principals at both elementary and secondary grade levels served as 
primary subjects for the nationwide survey, addressing those grade levels 
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which had been Identlfed in prior research as Important transition points 
and the^at^gets of frequent testing. The research commenced with an exten- 
sive literature review and exploratory fleldwork In three school districts 
across the country to Identify relevant contextual variables and to deepen 
our understanding of teachers' and principals' orientations. Case study 
inquiry following the survey explored in greater detail issues associated 
with the costs of testing. ^ 
Policy Orientation: Questions and Issues of Interest 

As the discussion above suggests, educational achievement testing is a 
pervasive enterprise, one which recurrently affects the lives of all 
students. It is an enterprise which is rapidly changing, diversifying and 
expanding. And it is an enterprise in which hundreds of roini6*ns of 
dollars in public monies are expended annually. It is not surprising, 
then, that it generates a broad range of questions and issues for 
policymakers to address. The CSE study examined a number of these: 

Competency testing . Across the nation, more than 40 states have now 
mandated tests of minimum competency for school children. Some states 
require such tests for promotion and graduation; others for checking 
students' basic educational needs at milestones in their school careers. 
Decisionmakers at all levels need to know how these testing programs are 
influencing students' educational experiences and life chances. What are 
the impacts of different kinds of minimum competency programs? Have they 
affected curriculum and Instruction? Have the^ wrought changes in the 
other ways districts and schools measure students' progress? 

Testing for federal and stfc*.e program evalution . Federal and state 
categorical programs, meanwhile, continue to Include evaluation require- 
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ments. Testing student achievement remains a primary way of meeting those 
requirements. Program administrators and technical assistance personnel In 
both funding agencies and participating districts, along with legislators 
and their advisors, need cost benefit information on testing in this 
context. Can it and does it serve purposes beyond accountability and 
compliance? How does testing for federal and state program evaluation 
affect the instructional time of participating students? How does it 
Influence the distribution of instructional staff members' energies and 
efforts? 

District continuum testing . Simultaneously to the above activities, 
many school districts are expanding their own testing programs. And 
Increasingly these district tests monitor students* progress along 
district-mandated sequences (or continua) of skills or objectives. From 
district to district, however, teachers may differ in their willingness to 
administer such tests and to utilize the results. Under what conditions, 
then, are test accompanying skills continua most likely to be administered 
and used in instructing students? What qualities should the tests have to 
be maximally useful? How can they be effectively integrated with other 
assessment activities? District administrators require information to 
resolve these Issues. 

Teacher-c o nstructed tests and other assessment techniques . Teachers 
themselves seem to spend significant amounts of their assessment time in 
administering tests and quizzes that they construct. They also seem to 
devote considerable attention, especially in the elementary grades, to 
commerically produced tests that come with curriculum materials. What are 
the qualities in these kinds of tests make them attractive and useful? 
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De fining the Research Problew 

Given the vast array of policy Issues and information needs 
surrounding educational testing, how should a national student survey be 
focused? CSE's Test Use Survey wa.s guided by two Interrelated concepts: 

- the concept of the teacher as practical reasoner and decision-maker; 

- the concept or' testing as an intervention 

' The teacher as practical reasoner and decision-maker . The view of 
teachers as practical reasoners and decision makers emerges from theory and 
research from the branch of sociology known as ethnomethodology (Cicourel 
1974; Garfinkel, 1967; Cicourel, & Kitsuse, 1963; Leiter, 1974; Mehan & 
Wood, 1975; Welder, 1973; Wood, 1968). According to this view, as 
practical reasoners and practical decisionmakers, members of social units: 

- Orient their activities to the practical tasks they must 
accomplish in their everyday routines and do so in light of the 
practical contingencies and exigencies they face; 

- Carry out their activities based on their "background under-^^ 
standings" of a "world known in conmon and taken for granted" 
(Schutz, 1962). That world is validated and supported daily 
through members' collective activities. Members act as "neive 
phenomenologists," taking things as they seem to be until 
unfolding experience proves them to otherwise. Thus they 
sustain their orientations to their practical tasks and 
circumstances. 

Data from the Test Use in School Study's planning-stage fieldwork 
efforts support such a view. That teachers do orient their efforts to the 
practical tasks that are demonstrably central in their everyday 
professional lives and do orient to the practical exigencies they face was 
recurrently documented. Teachers, for example, reported their uses of test 
results as serving most heavily the functions that are central to their 
routine teaching responsibilities: deciding what to teach and how to teach 
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1t to students of different achievement levels; keeping track of how 
students are progressing; and evaluating and grading students on their 
performance (Dorr-Bremme, 1983). Further, the means of assessment that 
teachers reported using most often and in the greatest variety of ways were 
those which facilitate the accomplishment of their practical activities and 
respond to the practical exigencies they face. 

A variety of routine tasks constitute the*^ world of teaching as 
practiced. Teachers must accomplish these tasks 1n a context characterized 
by recurrent time limits, others' demands for high performance and 
accountability, and their own concerns with providing effective and 
appropriate instruction. These features of the teaching world impinge 
upon teachers' testing practices and test use. Thus, it appears that their 
reasoning and decision-making about asssessment and its uses are structured 
by and oriented to their practical circumstances. 

Testing as an intervention . A second concept framing the Test Use in 
Schools survey was the concept of testing as an intervention. From this 
perspective, required or recommended tests, by virtue of their very 
presence in schools can impact educational practices. They can, in fact, 
function as change agents. Supporting this point of view, planning stage 

research indicated that: 

1. Mandated tests can add new standards of accountability to those 
that teachers must attend to in their everyday routines. Reasoning 
practically, teachers may feel responsible for adjusting their instruction- 
al emphases and techniques to match the skills and Information students 
must- master to do well on required tests. For example, minimum competency 
tests, particularly those required for graduation, seem especially likely 
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to re-orient teachers' practical reasoning and instructional planning and 
Induce them, individually and schoolwide, to alter curriculum and teaching 
methods. 

2. Mandated tests can change the practical circumstances under which 
teaching and learning must be accomplished. Respondents in the exploratory 
field research, for instance, cited a number of unintended, largely neg- 
ative, effects of testing programs, e.g, reduction 1n time for teaching. 
Where consequences of this type occur, they alter the practical contingen- 
cies that teauhers face In accomplishing their routine activities. As they 
do, they may occasion broader changes in Instructional practices, curricu- 
lum, and perhaps in students' learning as well. 

3. Mandated tests, where they respond to teachers practical exigen- 
cies, can provide new ways to accomplish routine tasks and can signal new 
approaches to instructional practice. Fleldwork in two districts, for 
example. Illustrated the ways in which a district continuum test can re- 
spond to teachers' assessment needs and facilitate more individualized in- 
structional approaches. Under such circumstances, testing programs of par- 
ticular kinds can. serve as agents for educational change. 

Framework for the National Survey 

The two nelated concepts of the teacher as a practical reasoner and 
testing as an intervention provided a useful organizing framework for the 
national .survey of assessment practices and uses schools and classrooms. 
In addition to inforjiing the selection of dbmains to be examined in survey 
questionnaires, this framework indicated some interesting relationships to 
be explored. These domain.s and hypothetical relationships are displayed in 
Pigur^l. (Notice that not all the relationships portrayed there were 
examined in the national survey.) 
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Federal /state/1 ocd> testing requirements . Attention to such require- 
ments responds to the concept of testing as an Intervention. As depicted, 
testing requirements influence the distribution and frequency of types of 
testing at local sites, and thus bear upon patterns of test use. (That is, 
districts may Introduce innovative tests that teachers use heavily to 
replace self-constructed tests, etc. Federal and state evaluation require- 
ments may encourage consolidation of assessment activities and use of 
extant tests for "new" purposes, or they may simply introduce additional 
testing at local sites.) Following the chain of posited relationships 
further, testing interventions such as minimum competency programs may 
Impact on the organization of curriculum and Instruction (as described 
above). 

Given that types of assessment seem to impact on one another and given 
the seeming Importance of minimum competency testing as an agent of change, 
districts were sampled on presence/absence of statewide assessment and on, 
various conditions of minimum competency testing. Data on the federal-, 
state-, and district-Initiated testing In sampled districts and schools 
were elicited In brief, initial, district-contact phone interviews with 
district testing officers and through principal questionnaires. 

Federal /«^tate/local programs . The presence/absence of particular 
federal and state categorical programs, and local educational programs as 
as well, is assumed to influence how curriculum and Instruction are organ- 
ized in schools and, In turn, the routine tasks of local -site practi- 
tioners. (For Instance, Title I and Title YII programs and programs 
developed In response to Public Law 94-142 occasion referral, placement, 
and diagnostic decisions.) The testing that occurs and the test scores 
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that are used follow from needs Inherent in these routine tasks. 

The study was not explicitly Interested In studying how federal, 
state, or local programs impact on the organization of curriculum and 
irstructlon locally (dotted line, arrows). It was only Interested In the 
presence-absence of the Instructional alternatives such programs provide. 
Thus, only Information on district and school participation 1n major, 
Instnicti on-related federal and state programs, e.g., Title I, (Chapter 2) 
was gathered. ^ 

Organization of curriculum and Instruction . The organization of 
curriculum and Instruction constitutes a main influence on the nature of 
teachers' routine, practical activities and decisions. If students are 
grouped by reading level or set to work In Individualized, self-paced 
learning programs, the teachers need to make placement decisions. If a 
continuum of objectives or "management system" 1s established then teachers 
must monitor learners' progress through that continuum. If team teaching 
Is practical or aides are available for Instructing students, students must 
be distributed to the instructional alternatives afforded by extra 
personnel (Yeh, 1978; Yeh, 1980). In summary, it was hypothesized that a 
igreater variety and number of available instructional alternatives in the 
''^classroom and school would Increase the routine tasks and decisions that 
require assessment information, and so Influence both the patterns of 
testing that occur locally and the ways test scores are used locally. 

Data on the organization of curriculum and Instruction were gathered 
primarily on teacher questionnaires: e.g., the presence/absence of aides 
and team teaching, the ways teachers distribute students for instruction 
within the class, presence and type of instructional support services 
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beyond the classroom. Information on the latter was also elicited from 
principals. 

Types of students served . The nature of practitioners' routine, prac- 
tical activities and decisions was assumed to vary with the types of 
students enrolled in the school and assigntd to a teacher's classroom. 
Students whose first language is not English, who are members of socio- 
economically depressed and/or culturally different populations, whose rate 
of achievement is unusually rapid, and so on, present teachers with differ- 
ent kinds of instructional challenges and decisions. Thus, the types of 
testing given locally and the uses of test results are likely to vary with 
the demographic or achievement characteristics of children in the school 
and classroom. 

Breakdowns of sampled schools' enrollments by socioeconomic status (as 
indicated by percent receiving Aid to Families with Dependent Children, 
percent receiving free lunch, iind similar indices) and ethnic identity were 
elicited from principals. Principals were also asked to provide contextual 
information on the rate of transience in school enrollment ye^r-to-year and 
on recent general enrollment trends. 

Teachers' perceptions of the utility of tests and types of tests . As 
teachers go about the accomplishment of their practical tasks and dt - 
sions, the instances in which they refer to test scores and the ways in 
which they "count" or "weigh" test scores are assumed to vary with their 
perceptions (opinions, values, understandings) of tests and types. of tests 
(See Lazar-Morrison, et al., 1980; Yeh, 1980). 

Survey instruments for teacher respondents gathered data on teachers' 
perceptions and beliefs about testing particular types of tests and testing 
in general . 
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Teachers' experience and training . As they go about making sense of 
. . particular tests' strengths and weaknesses, appropriate uses, and the like, 

teachers (the model assumes) will draw upon their formal educational and 
practical experiences with respect to testing. Thus, their training and 
experience are likely to be&r ultimately on their practical decisions about 
which types of test scores to use and how to use them. Teacher 
questionnaires asked respondents to report succinctly on the number of 
years they have been teaching and the number of years they have been 
teaching in their present school. (The latter was assumed to Index 
teachers' familiarity with existing local assessment programs and 
practices, socialization to local norms and values, etc.) Information on 
teachers' educatiohal background knowledge and In-service training 
experience also was elicited. 

District and local site leadership action . It was assumed that inno- 
vative district and school leadership can provide In-service training 
experiences that change teachers' perceptions of the utility of particular 
tests and types of tests, thus Influencing teachers' practical test-use 
decisions. District and school leaders can also. It was posited, act to 
generate tests, testing programs, and testing practices that facilitate 
teachers' accomplishment of their routine tasks under the practical exigen- 
cies of their environments (See Dorr-Bremme, 1983). Finally, district and 
school leaders may act to require that teachers use certain test scores for 
particular purposes. 

The study was not explicitly interested in how types of leadership 
action impact on types of In-service training in testing (dotted lines, 
arrows). The study was Interested, however, in how leadership activities 
o^' particular kinds impact on test use (solid line, arrows). Data on 

ERIC 18 



- 13 - 



d1str1ct-w1de leadership action were collected 1n Initial -contact phone 
Interviews with district testing officials and on principal 
questionnaires. Information on school-site leadership was gathered from 
teacher questionnaires. 

Types of tests given; purposes and frequency . Describing the types 
of tests given at local school sites was a central goal of the study. 
too was identifying the factors that influence the purposes for tests and 
the frequency with which they are given; hence the inclusion of the domains 
discussed in the foregoing paragraphs. 

The model assumed that the types of test given locally, and the 
purposes for and frequency with which they are given, will Influence local 
types of test-score use. This assumption was made for more than the obvi- 
ous reason, that the giving of a type of test makes its scores available. 
It was also posited that the presence/absence of one type of test may 
influence the use of scores from another type. TTie giving of minimum 
competency tests as a requirement for graduation, for instance, may encour- 
age teachers to use the results of other kinds of tests to measure 
students' progress toward attainment of the minimum competencies. (This 
phenomenon was observed in a junior high school visited during exploratory 
field work.) Similarly, the absence of particular types of testing in a 
local setting may co-occur with more diverse uses of the results of tests 
that are given there. 

Data on the types of tests given, and on the purposes for and fre- 
quency with which each is administered, were elicited from both teachers 
and principals, assuring a comprehensive picture of the pattern of testing 
in each school and classroom sampled. 
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Types of test score use . Describing how scores from particular types 
of tests are actually used was another primary goal of the research. And 
Identifying the factors that Influence typ^-of-test-score/type-of-test-use 
relationships was yet another. 

Information on how scores from particular kinds of tests are used In 
classrooms was elicited on teacher questionnaires. Data on other, 
school -wide uses of test scores was gathered on principal questionnaires. 

Impacts . As Figure 1 shows and as earlier discussion has explained, 
it was assumed that testing can have Influence within schools In two ways. 
First, testing can have influence through practitioners' use of test scores 
In decision making. For example, curriculum program and/or instructional 
strategies might be changed in response to a program evaluation including 
test scores as measures of program effectiveness. Test scores might influ- 
ence student placement decisions. Second, tests can impact on. curriculum 
and instruction by virtue of their very presence as required or recom- 
mended. In the stuciy's conceptual framework, then, both "types of test 
score use" and "types of tests given" are assumed to have potential Impact. 

The conceptual model also calls attention to the study's interest i_n 

the Impacts of particular types of testing and test-score use for learners 

in general and for particular types of learners (referenced as "types of 

students served"). The model also indicates the interest of the research 

In Impacts of particular types of testing and test-score use on curriculum 

and instructional activities. These potential impacts were discernible in 

the research through: 

(1) Questionnaire items that investigate the ways in which test 
scores are used. 
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(2) Questionnaire Items that asked about respondents' perceptions 

V of the impacts of particular types of testing on their students, 

classrooms* and schools. 

(3) Data analyses that examined relationships between types of 
students served (e.g., by socioeconomic condition and amount 
of testing, types of tests given, and patterns of test score 
use.) 

The Survey Sample 

The survey addressed a nation-wide sample of principals and teachers 
drawn through a successive, random- selection procedure. Given the stuc^y's 

« 

intent to provide a comprehensive picture of current testing practicei?\^ 
sampling procedures were devised to yield a nationally representative 
sample of respondents. Stratifying variables reflected this concern for 
representativeness, as well as the need for variables whose values were 
easily attainable; these included geographic region of the country, 
district size, urban-suburban-rural locale, socioeconomic status, and mini- 
mum competency testing policy. Thejatter two variables also reflect the 
study's interest In clarifying policy issues, though the number of policy- 
relevant sampling variables which could be Included in sampling was 
severely limited by available information. While It might have been 
interestTibg to stratify the sample based on district leadership or types oi 
district-required tests, for example, no prior Information existed which 
would permit selections based on these variables. 

Respondent sampling proceeded as follows. First, a nationally repre- 
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Burry et al . , 1982 
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sentative probability sample of 114 school districts was drawn. (A lattice 
sampling technique was used to select •ells from the matrix defined by the " 
five stratifying variables. Then random sampling was done to select within 
cells.) Next, from within these districts, size permitting, two elementary 
schools and two high schools were randomly selected using a procedure that 
facilitated (where possible) inclusion of schools at levels serving both 
higher- and lower-income populations. Finally, in each of these schools, 
principals received directions for randomly drawing four teachers for in- 
clusion in the study. Directions for elementary principals guided the ran- 
dom selection of two fourth-grade and two sixth-grade teachers; those for 
high school principals directed the random selection of two teachers of 
tenth-grade English and two of tenth-grade mathematics. 

The principal and each of the four participating teachers at each 
school received questionnaires that elicited detailed information on their 
individual and school testing practices, as well as related contextual and 
attitudinal data. 

Return rates . Returns were obtained from 220 principals, 475 elemen- 
tary-school teachers, and 363 high-school teachers in 91 of the 114 
districts sampled. Return rates from all principals and from teachers at 
the elementary level were approximately 60%. About 50% of the high school 
teachers in the sample responded. To correct for differential return rates 
by sampling cell, and to approximate a nationally representative distribu- 
tion of respondents, weightings were applied in all descriptive analyses. 
The results reported in the following chapters, therefore, represent 
weighted estimates of national testing practices, test use patterns, and 
principal and teacher perceptions and beliefs on testing-related Issues. 

What was the nature of the selected schools, their teachers and 
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classrooms? In order to provide context for understanding the results 
presented 1n later chapters, the remainder of this section describes the 
characterl sties of the school environment in which the respondents operate 
and then the teachers themselves. 

The average elementary school in the sample served a total enrollment 
of 528, comprised of a majority Caucasian but ethnically mixed student 
population. While the typical school community was economically 
heterogeneous, a significant minority of students receive federal aid 
and/or qualified for free school lunch benefits. Transiency and absence 
rates were relatively modest, 16 and 6 percent respectively. A majority of 
the schools {60%) operated a school Improvement program, and student 
achievement testing was typically Included and required in such programs. 
Over one half of the schools operated under minimum competency testing 
requirements; while within these schools most students passed such required 
tests on the first try, a sizeable number of students {ZQ%) typically - 
experience failure. (See Table 1) 

Secondary school enrollments, as would be expected, were substantially 
higher, with a mean of 1439. While other characteristics were quite 
similar to those at elementary school level, students in the average high 
school in the sample appeared slightly more economcially advantaged and 
less transient. 

The average teacher within the schools described above had approx- 
imately twelve years of teacht »g experience, almost ten of which were in 
their current district. (The results are presented in Table 2.) In terms 
of their education the respondents were almost evenly split between those 
holding Bachelors degree and those holding a Masters degree, with less than 
1% holding a doctorate. Further, they tended to average some 24 to 25 
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Table 1 ^ 
School Characteristics 



Total Enrollment 



Elementary 
Mean S.D. 
528 (235) 



Secondary 
Mean S.D. 



1439 



(696.3) 



Black 


15.0% 


(25.8) 


15.0% 


(25.5) 


Hispanic 


8.1% 


(21.2) 


6.8% 


(18.4) 


Asian 


2.1% 


( 9.2) 


0.7% 


( 1.2) 


Native American 


5.5% 


(20.4) 


0.4% 


( 2.1) 


Caucasian (Euro-American) 


70.6% 


(35.8) 


76.2% 


(31.0) 


Other 


1.2% 


( 9.9) 


0.7% 


( 5.7) 



Soclo-Economic Status 

Low income (< $8,000) 
. /----Hiddle Income 
/ H^h income (> $25,000) 

% of students receiving 
AFDC or free lunch 

Transiency Rate 

Absentee Rate 

School Improvement Program ■ 
% Participating 
% Requiring Testing 

Minimum Competency Testing 
Required 

% Students passing first time 



29.0% 
50.6% 
20.5% 



(26.2) 
(23.4) 
(21.7) 



22.4% 
56.7% 
21.8% 



(20.2) 
(19.3) 

(17. ei' 



31.0% 


(26.2) 


23.2% 


(22.8) 


15.5% 


(13.7) 


10.4% 


( 7.8) 


6.0% 


( 9.4) 


7.4% 


( 3.7) 


59.7% 




63.0% 


M 


76.3% 


«W «K «M 


65.7% 


mm mm mm 


53.3% 




50.0% 


m» m m» 


80.0% 


(23.0) 


76.1% 


(22.6) 
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Table 2 
Teacher Characteristics 



Average Number of Years of 
Teaching Experience: 

Average Number of Years of 
Teaching In District: 

Percentage of Teachers whose 
Highest Diploma Is: 

Bachelors 

Masters 

Doctorate 

Average Numbers of credits/ 
units beyond last degree: 

Average Number of students In class 

Average Hours per week of 
Reading or Math: 

Average Hours per week of Mathematics 



Elementary Secondary 
12.03 (7.50) 2.69 (7.50) 

9.68 (6.94) ' 10.04 (7.00) 



57.92 
41.65 
0.17 



50.66 
48.44 
0.91 



24.10 (24.39) 25.82 (22.34 

27.11 (9.45) 26.09 (9.84) 



6.55 (1.97) 
5.19 (1.44) 



5.38 (1.78) 
5.62 (1.67) 



25 

J 



1 

^ - 20 - 



college units beyond their highest degree. The picture of the teachers 
then, Is one of experienced, educationally qualified professionals who have 
continued to pursue' education. It is interesting to note how similar the 
characteristics were across the elementary and secondary levels. At bo^i 
levels, however, these characteristics appeared unrelated to testing 
practices. 

The routine of the classrooms these teachers taught in Is also 
described in the results found In Table 2. The results Indicate that 
teachers had In their classrooms approximately 27 students at the 
elementary level and 26 at the secondary level. At the elementary level, 
they provided over 6.5 hours of reading instruction per week and about 5 
hours of mathematics instruction. The results at the secondary level were 
similar for mathematics, i.e., about 5.5 hours of instruction per week. 
However, fewer hours of English instruction occurred at the secondary level 
(approximately 5.5 hours) than reading instruction at the elementary level, 
reflecting both the greater emphasis on reading earlier in a student's 
career and the broadening of the curriculum as a student progresses through 
higher grade levels, as well as standard class periods at the secondary 
level. It will be useful to compare these average hours of weekly 
instruction with the amount of time devoted to testing. This Is done in 
the next chapter, where the frequency of testing and the time it takes are 
described. 
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CHAPTER 2 ^ 

ASSESSING STUDENT ACHIEVEMENT: 
THE FREQUENCY OF TESTING AND THE TIME IT TAKES ^. 

it 

As CSE researchers Interviewed teachers across the United States, they 
^spoJce of the many ways In which they assess students' progress and monitor 
the results of their teaching. Routine class and homework assignments, 
teachers pointed out, provide recurrent information on students' learning. 
Classroom Interaction — during questlon-and-answer recitation and 
discussions, when students ask for help with their work, as they read 
orally or work problems at the board, etc. — yields immediate, continuous 
feedback on how students are doing. Special projects, presentations, and" 
rep' ts offer additional data on student progress and teaching effective- 
ness. Testing, then. Is viewed by teachers as only one among. the many 
strategies In their repertoire for measuring students' achievement. 

Testing , teacfiers' interview remarks Imply, means for them eliciting' 
information from Individual students, usually through paper-and-pencll 
instruments, under controlled conditions. I.e., conditions which preclude 
students' access. to texts, notes, and others' assistance. While tMs 
definition of testing is hardly unique, it does differentiate teachers' 
view of testing from their perspective on assessment in general. Frcm 
their viewpoint (as noted above), assessment of student achievement goes on 
constantly during the course of classroom teaching and learning. Testing, 
in contrast, occurs periodically In time set aside explicitly for that 
purpose. The amount of testing that teachers report thus represents only a 
small proportion of their assessment effects, an observation which provides 
Important context for interpreting the following discussion on how much 
testing goes on in schools. 
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CSE's national survey asked teachers to list each type of test their 
students receive over the course of a school year In reading or English and 
mathematics, the frequency with which each type Is administered to their 
"typical student," and the approximate length of time It takes that student 
to complete a usual test of each type. Teachers' responses provide a 
picture of the annual cUss time students spend taking, tests In these basic 
skills subjects. This picture Is described first In the sections below, 
then It Is supplemented with fleldwork findings that highlight some addi- 
tional time testing entails for both students and their teachers. 
The National Picture: Modest Awounts of Tlwe on Testing 

Elewehtary students spend less than 10 percent of the annual allocated 
Instructional tim In basic sfcllls testing . Table 3 shows the average 
annual time students devote to test taking, as well as the average 
frequency and duration of testing. In each subject and le\/el of schooling 
surveyed. 

As these figures Indicate, the typical student In the upper elementary 
grades spends about 10 hours a year taking reading tests and 12 1/2 hours a 
year taking mathematics tests. Test taking, then, consumes about four 
percent of the average time allocated to formal Instruction in reading and 
close to seven percent of the average time given to formal Instruction in 
mathematics during the entire school year. (These percentages are based on 
the average Instructional time reported by the elementary- school teachers 
surveyed: 6 1/2 hours a week in reading, 5 hours a week In mathematics. 
Here and throughout this section, calculations assume a school year of 37 
weeks or 180 days of actual instruction.) 
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Table 3 

Time Devoted to Testing in Typical Classes 



• t • 

•** • m 

* ' • >■ . 


ToUl hnmtor 
Pass Tie* ^pent 

on Testing 

perktnm 


. No. of Test 
' Sessions for 
topical Student 


of Session 


ElMientaiy Sdnol (Grades 4-6) 
—Heading T«its 

—Mathematics Trsts 


• • 
9 hrs. 56 nfn. 


• 

22 


27 mfn* 


12 hrs. SB nf n. 


• 23 


32 mln.^ 


10th Grade English Class 

• 


26 hrs. 34 mtn. 


49 


32 of n« 


ipth Grade Kathematlcs Class 


24 hrs. IS Bin. 


• 

45 


33 mfn. 



Table 4 " . 

• ■ Tinig Devoted'- to Required Testing, ^ • • . 

As a Percentage of Total Testing time 
For typical Classes" 



• 

• • 

• 


Pisi'ceRtj^ 
Tine on Testlrtg 

State 


Fercenta^ 
Ttne on Testing 
fiequlred tsf 
Local School 
Mstrlct 


Percentage 
T«ting Tim 

Devoted to 
(ton-Required 
Tests 


Elenentary School (Grades 4-6) 

• * 

—Heading 
— Itathcmatlcs 


30 
21 


29 
25 


41 

54 


10th Grade EnglUh Class 


12 

• 


; ■ 
13 


74 


10th Gracte Mathematics Class 


9 


14 


77 
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Elewenftary students take a test In reading and a test In mth about 
once every eight days . Students' test- taking time, of course, 1s seldom 
distributed evenly from week to week across the school year. Periods or 
more Intensive testing can occur at the elementary level, for example, 
during administration of placement and diagnostic measures, standardized 
test batteries (with their reading and math sub-tests), and end-of-book of 
end-of-level exams. Routine quizzes and chapter tests are often deferred 
at such tiroes or In other special circumstances. With this caveat, the 
averages In Table 3 yield rough estimates of general testing patterns. 
They Indicate that throughout the year the typical upper-elementary student 
faces a half -hour test in reading ^^di half-hour test In math about once 
in every eight school days. 



High scMl students spend 12 to 13 percent of their tlwe In English 
and aatheiiatics class taking tests . Students In high school appear to 
spend morejn their class time taking tests. Survey results reveal that 
the typical tenth-grader enrolled in an English class spends nearly 26 1/2 
hours yearly compreting tests in that subject; ThfsWnstTtu^^^ 
over 13% of their annual time English instruction, which teachers' 
reports indicate averages 5.4 hour?: weekly across the school year. 

A typical tenth-grade mathematics student devotes somewhat more than 
24 hour to math tests in a school year. At an average of 5 1/2 hours 
weekly for mathematics instruction, this equals about 12% of their class 

time. 

High school students take an English test and a aath test every 



three- to- four days , Table 3 shows, in the subjects surveyed the average 
testing session in tenth grade last only moments longer than In upper- 
elementary classes. On the average, however, the typical tenth-grader 
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is tested, about twice as frequentTj^. He or she encounters a half-hour test 
in English class >oughly every three-toci-a-hal f days; In mathematics class, 
about once every four days. ^ 

Mandated tests consuwe substantial proportions of students' total 
test- taking tlwe . How much of the test- taking time just destfffed results 
from tests mandated by agencies beyond the school? How much occurs at 
teachers' (Jiscretion? Table 4 provides answers to these questions. 
• • El emefltary-school teachers in the sample report that, on the average 
about'half their students' test-taking time in both reading 'and math is 
spent on measures required by their state or school district. At the 
high-school level, state and district mandates account for about a quarter 
of the time students spend taking tests in both English and mathematics. 
Notice, then, that since hi-gh school students on the average spend twice as 
much time annually being tested as elementary students do, these 
percentages suggest that the actual number of hours spent in required 
testiijg is quite similar at both levels of schooling. Notice, too, that a 
greater proportion of assessment in the high school subjects is voluntijry: 
conducted at the discretion of the individual teacher. 

Students spend west of their tlwe on teacher-developed tests . Which 
types of tests call for greater proportions of students' test-taking time? 
To address this quesion, the survey employed test-type categories that 
recurred consistently and spontaneously in the talk of teachers, school 
administrators, and counselors during open-ended pre-survey interviews 
The goal was to give survey respondents a categorization system as similar 
as possible to the one they use naturally in their everyday thinking and 
conversation about assessment. As Table 5 demonstrates, this system 
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Table 5 



Time on Different Tests, 
As a Percentage of the Total Student Time 
Devoted to Test taking 





Elementary 
Teachers 


10th 
Grade 
' English 
Teachers 


10th 
Grade 
Mathematics 


TYPE OF TEST 


Reading 


Math 


Teachers 


Tests which form part of a 
statewide assessment program 


3 


3 


5 


1 


Required Minimum Competency Tests 


1 


2 


1 


1 . 


Tests Included with currlculwn 
materials 


28 


35 


8 


17 


Other cornnerclally published tests 


17 


18 


6 


3 


Locally developed and district 
adopted tests 


13 


8 


5 


2 


School or teacher developed tests 


37 


35 


74 


76 
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differentiates tests primarily in terms of their point of origin, I.e., 
according to who develops the measure and/or requires Its use. 

A glance at the results In Table 5 shows Immediately that tests 
developed by Individual teachers and schools and, at the elementary level, 
those which accompany commercial curriculum materials, occupy the great 
majority of students' testing time. Notice that these are the types over 
which teachers have most control i They can administer them when they deem 
appropriate; they can design (or readily adapt) the content to suit their 
own teaching emphases. Most teachers Interviewed said that these types of 
tests fit best with their Instructional schedules and curricula. And, from 
their points pf view, these are the most valid Instruments of those listed 
for such routine tasks as grading, on-going planning of teaching, etc. 
{This will be discussed further in Chapter 3). The predominance of locally 
developed tests at the secondary level supports the notion that high school 
teachers have more control over classroom assessment than do elementary 
school teachers. But heavy use of locally developed tests in the high 
— ^hoot-s may a lso r eflect the limited njamber of suitable jjommercijLl t^^ 
materials available. Comprehensive curricular programs including texts 
with coordinated workbooks, tests, etc. — are more widely available for 
teachers of the elementary grades. 

Finally, note that the two types of testing most often generated by 
state policy — minimum con^etency testing and state assessment — consume 
on the average very small proportions of classroom testing time. 

The figures in Table 5 are averaged across all teachers in the survey, 
including those in states without minimum competency testing requirements. 
Even where minimum competency tests (MCT) are required in the grades 
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sampled, however, less than three percent of the testing time at the 
sampled elementary grade levels and two percent of the testing time in 
secondary grades and subjects sampled is taken up by these tests. Where 
MCT's are available, but not required, they absorb less than one percent of 
the total testing time In the grades and subjects surveyed. 

The picture with regard to statewide assessment programs is similar. 
Such programs require no more than three percent of the total annual 
testing tiirs at the elementary level (or about 45 minutes per year on the 
average for reading and mathematics combined). At the high school level, 
tenth grade English assessment programs typically take about 75 minutes 
annually and mathematics programs an average of 30 minutes per year. 

Mhere there are no state wtntM cowpetency, proficiency, or 
functional literacy testing requlrewents. students spend wore tlwe on 
classroow achievewent testing . Tests of minimum competency or proficiency 
or functional literacy are now required of all students in over 40 states, 
representing about two-thirds of the nation's student enrollment. In some 
states, passing' these tests is a prerequisite for promotion to certain 
grades and/or for high-school graduation. In others, they are mandated 
only for diagnostic purposes: to assure that students with deficiencies Jn 
basic skills are identified and offered remedial instruction. Furthermore, 
some states designate specific instruments that must be used in minimum 
competency testing, while legislation In other states permits local school 
districts to select or construct tests of their own choice. 

Teachers' reports suggest that these minimum competency requirements 
may somehow be affecting the amount of classroom achievement testing * 
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Table 6 

Relationships Between State Minimum Competenc)' Testing 
Requirements and Students' Test-Taking Time 

Reported In Minutes 



STATE 
REQUIREMENT 


SECONDARY 




ELD€NTARY 


English 


Math 


Total per 
Teacher^ 




English 


Math 


Total 
Per Teacher^ 


No Minimum Competency 
Testing (MCT) 


3723.53 


3173.38 


3455.01 




577.45 

* 


570.91 


1148.37 


MCT required for 
diagnosis, state- 
mandated measure 


915.77 


1180.50 


1086.47 




504.32 


488.15 


922.48 


MCT required for 
diagnosis, local 
choice of measure 


1600.07 


1394.57 


1482.77 




489.90 


486.32 


976.22 


MCT required for 
promotion or grad- 
uation, state 
measure 


1427.73 


805.15 


1095.86 




388.69 


632.88 


971.57 


MCT required for 
promotion or 
graduation, local 
choice of measure 

















1 Difference In mean values of different MCT categories statistically significant at 
p > .01. 

2 Difference In mean values not significant statistically. 



35 



teachers otherwise. do. At least, teachers' survey reports show that, 
when other sampling factors are controlled,* students 1n states with no 
minlrnum competency requirements at all spend more time on achievement 
testing each year than students elsewhere do. (See Table 6.) This 
difference Is dramatic (and statistically significant) at the secondary 
level, where all types of minimum competency requirements appear to be 
accompanied by much less classroom testing (from 33 to 45 hours less 
annually) and where competency requirements for promotion or graduation 
are accompanied by the least testing time of all. 

At present, this pattern is difficult to explain. On the surface, 
it seems to suggest that teachers have eschewed routine classroom test- 
ing 1n favor of minimum competency measures: that they are permitting 
minimum competency tests to take place of other forms of assessment. 
This interpretation, however, makes little logical sense. Proficiency 
or minimum competency^tests are given only at certain grade levels. 
Typically, too, they are given in those grades only on a single 
occasion. Thus, they cannot possibly supply the feedback on student 
performance that teachers need regularly for monitoring students' 
learning progress, assigning report card grades, making on-going 
teaching plans, and so on. Furthermore, fieldwork visits to various 
states with different minimum competency requirements revealed no 
reduction in routine tests and quizzes. In fact, fieldwork suggested 
that at least in the districts visited, additional time can be spent in 
testing to assure that students perform well on minimum competency 
measures. Nevertheless, careful review of the survey Instruments and 
the statistical analyses to which they were subjected substantiates the 

* Other factors considered in sampling include districtwide 

socioeconomic status, district enrollment size, geographic region in 
the nation, and urban-suburban-rural locale. See the introduction 
for further details. or* 
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findings displayed In Table 6. The processes that underlie and explain 
these results await further study. 

Socloeconwrtc status (SES) seeas unrelated to students* test-taklng 
tlwe . Given the evaluation and testing requirements that are commonly 
associated with compensatory education programs, and given that these 
programs serve ^tudents from lower socioeconomic backgrounds, many 
people have speculated that lower SES students spend more of their 
school time on testing than students from higher SES homes. CSE survey 
results, however, indicate that this is not the case. Students in lower 
SES areas do not spend more time taking tests than thdse in middle- 
Income or upper-income settings, nor do they even spend more time taking 
tests required by their district, their state, or in conjunction with 
federal educational program guidelines. This finding holds true 
regardless of whether a district-level or a school-level indicator of 
socioeconomic status is used. 

In concluding this section, it is also worth noting that no other 
variable included in this study (except minimum competency requirements) 
appeared to have any relationship with the amount of time students spend 
taking tests. 

Case Studies Provide A Closer look At ToUl lime On Testing . 

The discussion so far has centered on how much testing goes on in 
the basic-skills subjects of reading or English and mathemat1c| across 
the nation's schools. Emphasis has been on the frequency of testing and 
on the class time students spend with tests in hand, actually completing 
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them. Survey questions purposely focused on these topics as especially 
relevant to a portrait of national practices.* Fleldwork results 
elaborate these findings, providing an Illustrative look at all the time 
students spend on testing, at teachers' testing time, and at time on 
testing across the curriculum. 

Testing consuies student tlwe before and after the test . In most 
classrooms, testing demands more class time than that required for 
students to complete their tests — time which Is spent both before and 
after they answer test questions. Wide-ranging Interviews with 
teachers, conducted by QSE both before and after the national survey, 
Illustrate how this time Is spent and how much It can add up to. 

Preparations for testing can begin days or even weeks before the 
test Is given. At a minimum, teachers Inform their students when the 
test will be, explain what It will cover, and say a word or two about 
the question formats that students can expect. When mandated measures 
such as standardized batteries or minimum-competency tests are due, 
however, some teachers spend class time to train students In their 
specific response formats and/or in general te^t- taking strategies. 

i 

Some also suspend teaching of the on-going curriculum, devoting class 
time Instead to review and practice of skills and content that they know 
these tests will cover. 

* In addition, project resources were Insufficient to examine testing in 
all subject areas, and both pre-survey interviews and questionnaire 
piloting confirmed that eliciting information on all the time 
associated with preparing for, taking, and reviewing test would place 
an enormous response burden on survey recipients. 
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When the testing day arrives, of course, time Is required for 
passing out materials, giving directions, and handling students' 
questions. In order to provide an appropriate environment for testing, 
some teachers say, they routinely allow several moments for "settling 
students dQwn" and/or rearranging students' seating. Filling In 
student-identification information and covering directions can be espe- 
cially time-consuming at the outset of special testing episodes. At the 
elementary level, teachers often report spending a half-hour or more on 
these preliminaries when standardized testing, state assessment, or 
minimum competency measures are administered. Moving students from 
their classrooms to special testing locations (the library, cafeteria, 
etc), as Is sometimes done for the latter types of assessment and for 
high-school finals, is another before- testing activity that can take up 
time. 

Once students have completed a test, class time is given over to 
collecting papers. Sometimes, tests are corrected in class. Then, If 
necessary, regular classroom seating patterns are restored. Nearly all 
teachers ifl^-the el^mefltary grades report-that- they-regttl-arl:y-"set -as tde ~ 
time for students to "relax" or "cool out" after particularly Important 
or lengthy examinations. Some high schools accomplish this with special 
school wide schedules for finals and (less often) mid- terms. 

The amount of class time such activities as these consume appears 
to vary markedly from classroom to classroom and school to school. In 
two elementary schools, for example, every teacher in grade K through 6 
was interviewed about all the time their students spend on test-related 
activities in all subjects throughout the school year. In one of these 



39 



schools (Hillvlcv; Elementary), students usually spend an average of 91% 
of their total, testing-related time actually answering test questions. 
Only 9%, on the average, of the typical ^u^nt's- total time on testing 
each year is taken up with before-the-test and after-the-test activities 
of the kind described above. In the second elementary school 
(Cityslde), however, much more time is routinely spent on pre- testing 
drills and review which, teachers avowed, were undertaken only because 
mandated testing was about to occur. Furthermore, logistics in support 
of testing — scheduling changes that reouced class time; room 
reassignment for testing, etc. — claims a great deal of instructional 
time during required-test administration each spring in this densely 
populated school. Thus, students here spend only 55% of the average 
annual time devoted to test related activites actually taking tests. 
They devote, nearly as much time each year, in other words, to 
before-the-test and after-the-test activities as they do to test 
taking. (For details on these two schools, thir testing programs, and 
their districts' testing programs, etc., See Dorr-Bremme et aj , 1983.) 

Similar interviews were conducted, although less intensively in any 
one school, with high school teachers. These suggest that secondary 
students usually spend 10 to 15 percent of their total yearly testing 
time In any one class on before- and after-testing activities. 

The percentages offered here, of course, are only illustrative. 
Nevertheless, they do provide useful context for interpreting the 
national averages of students' test-taking time cited earlier. 

In two ela^ntary schools, testing across the currlculua consuaed 
etght to ten percent of students' available Instructional tlwe How 
much time do students spend on all test-and- testing related activities 
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in subjects across the curriculum? 4F1e1dwork interviews in the two 
schools mentioned in the last section also provide illustrative answers 
to this quesion for students in elementary school. In the first of two 
schools (Hi 11 view), for instance, an average students devotes 88 hours a 
year to preparing for, taking, and winding up and going over tests in 
all subjects. This comprises about 10% of their annual class time 
(which equals five hours daily, excluding lunchtime and recess, over 177 
school days, or 885 hours per year). Across classrooms in the other 
elementary school cited above (Cityside), students* total testing time 
in all subjects averages 76 hours a year, or 8.6% of their annual class 
time of 385 Jiours. Observations of testing episodes —/Including the 
before, during, and after phases — suggest that the interview estimates 
upon which these totals are based are generally quite accurate. 

Tables 7 and 8 show how this time is distributed by subject area. 
Notice that all teachers do not test in all subjects and that testing in 
the basic skills subjects of reading and mathematics (not including 
multi-subject batteries which also cover these subjects) consumes about 
50% uf students' total time on testing in these two schools. 

For each hour that students* spend taking tests, teachers seen to 
spend twb-to-three wore . The annual times students spend on test- taking 
(Table 3 above) can serve »s a rough indicator of the times that 
teachers spend giving tests in the classroom. CSE's Interviews with 
teachers confirm that in most cases teachers actively monitor the class 
and answer students' questions as testing is in progress. These same 
interviews, however, suggest that teachers spend only about a quarter to 
a third of their total time on testing in this way. That is, for each 
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TADIE 7 

HILLVIEW SCHOOL ■ LITTLCTOM DISTRICT ' 
OISTRIBUTICM CF STAFF i STUDENT TESTlNfi TIIC 
By Subject 



Each staff category cell shows: 

• to. of staff minbers involved 

• Avg. hours/staff nenlser/year 

• % Total testing tltrn for 

staff cat^ory 



SUWECT 
AREAS • 


AOt'iINISTRATORS' 
TIME 


CLASSR0a4 
TEAOIERS' 
TIME 


INSTRUCTIONAL 
SPECIALISTS 
TIf« 


YOLUMTEERS* 

TTMT 
i IImL 


TOTAL STAFF 
TtrC (In 

1 iiV* 1 All 

Person Hours) 


AVG. STUDENT 

TIME PER 
STUDENT (hours! 


NUMBER CF 
CLASSROOMS 
Total • 30 


Reading 


• 


11 

52.47 
20.7X 


1 

17.4 
. 8.8t 


1 

• 6.4* 


19.01 


12.12 


• 11 


Mathetnatics 




11 

* 77.11 
30. St 


1 

53.9 
27.3* , 


3 

59.71 


30.0* 


25.11 


11 


Language Arts 




8 

24.30 
7. OS 


1 

34.75 
17.61 




7.31 


7 ftl 


8 - 


Spelling 




8 

. 51.42 
14.8t 


1 

21.58 
10.91 




13.71 




8 


Social Studies 


* 


5 

19.55 
3.51 






97 75 
3.11 


4.53 


5 


Science 




5 

28.0 
5.0t 


• 




140.0 
4.4* 


S.8 


S 


Health - Phys. Ed 


• 


•0.9* 






25.0 
0.8* 


. 7.19 


3 


Other, 
Miscellaneous 




3 

8.61 
l.Ot 


1 

70.0 
35.4% 




95.83 

3.0* 


3.39 


3 


rtjlti-SubJect* 

• 


2 

49.87 
100. Ot 


U 

42.06 
16.6% 




3 

8.70 
33.9* 


588.77 
18.6* 


23.93 

» 


11 


TOTALS By sUtT 
category 

(In person hours) 


sy./& 
lOO.Ot 


lOO.OS 


- ig/.6J"" 

.100.01 


//.'bb'"" 
100.0* 


99.9* 





• The hLUi-suWect cateooiy Includes standardized tests *hich assess perfomance in several st*Ject areas. Also included in this 
SiSIv il tte LSra? S^te^^ given twice a year at the sare tine as (i.e.. on a d^y contiguous with) the 

Sailed tosrSie rirpJS^^^ 'r^SrSftin^ devoted to the intelligence test as separate frtn that given to the 
standardized test; others did not. Thus, time devoted to both is collapsed here. ? 



■ ■ TABLE 8 ■ 

CITYSIOe SCHOOI. - METRO DISTRICT 
OISTRIDWION CF SWF « STVDEWT TESTINQ TIME 
' ^ subject 



Ueh stiff category eell shows} 

• Mjt of staff ineroers Involved 

• Avg. hours/staff neniber/year 

• % Total testing tlna for 

staff category 



SUBJECT 
AREAS 



Reading 



Mathefflatles 



ACHINIS- 
/TRATORS 
TIKE 



2 

139.66 
74. SX 



CURICAL ClA$SR00t4' StSTRUCTIONA 
TIHE TEACKERSMSPECIAIISTS' 
TIME I TIME 



X 

10.3 
100.0S 



28 
64.61 
2S.6S 



1 

74.0 
45.01 



27 
67.68 
30. 5« 



AIDES' {Para- iVOLlMTEERS' 
professional s}f XM. 
TIME 



TOTAL STAFF | AVG. STVOEMT IHUTO CF 
TIME (In TIME PER ClASSROCMSl 
Person Hours) S1V0ENT Ihours) Total • 301 



26 

15.31 
30,7S 



1 

11.67 
12.6t 



2302,42 
28.81 



9i43 



25 

16.51 
29.92 



2 

33.06 
71.0X 



2276.38 
' 26.6t 



21.01 



26 



27 



language Arts 



16 
26.42 
6.81 



10 
3.63 
2.8!l 



443.0 
5.5S 



18,71 



Spelling 



22 

5>%25 
20.QS 



10 

11*17 
15.5t 



1 

9.17 
10.01 



1403.67 



25.83 



Social Studies 



10 
17,65 

2.gs 



6 

4.12 
1.9« 



201.20 
2.6X 



* 10.33 



Science 



5 

16.4 
1.4S 



2 

0.63 
0.091 



83.25 
l.OS 



4.33 



16 



22 



10 



Health - Phys. Ed 



6 

16.55 
1,7S 



6 

9.S2 
4.4» 



156.47 r 
2.0t 



30.28 



Other, 
Miscellaneous 



6 

40.27 
4.0t 



1 

74.0 
45.01 



4 

10.34 
3.2S 



356.96 
4.5S 



0.39 



ftiltl-Subjeet 



3 

31.90 
25.51 



26 

16.24 
7.11 



*2 

8.16 
10.01 



28 
5.39 
11.61 



2 

2.6 
5.61 



690.45 
9.41 



9.62 



TOTALS staff 
category 

(In person hours) 



375.0 
100.01 



10.3 
100.01 



5975.32 
•'100.01 



164.33 
100.01 



W98.6 
100.091 



92.22 
lOO.Ol 



7915.8 



26 
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hour they devote to giving a reading or math test, they typically spend 



another two or three hours on such activities as preparing for testing 
(e.g., constructing tests and dittoing them, reviewing directions for 
state assessment or standardized- test administration), correcting and 
grading tests, recording scores, etc. At the elementary level, teachers 
also find that they spend' a good deal of time checking over special 
answer sheets used for machine scoring to be sure that the 
identification information is correct, that there are no stray pencil 
marks to throw off the scoring, etc. 

Interviews with elementary- school teachers indicate that they spend 
about 12 to 15 percent of their annual reported work time, both in and 
out of school, on achievement testing in all subject areas. This 
averages about 200 to 250 hours through a school year. (Similar figures 
are unavailable for high-school teachers, but they do appear to spend 



Tables 7 and 8 also display the total time on testing that teachers 



in the two case study elementary schools (Hi 11 view and ptt/side) spend 
annually on testing 1n each subject. Note that testing in reading and 
mathematics together demands over 50 percent of the total teacher time 



on testing at each school. If the testing in these subjects that takes 
place as part of multi-subject batteries were included, this percentage 
would be higher. 

Other staff ■ert)ers' time on testing . Administrators, as well as 



classroom aides (or paraprofessional s) and volunteers, also play a role 
in^the work of testing. Classroom assistants spend their time much as 



testing.) 



two hours or so outside of class for every 
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teachers do: proctorlng test administration, grading tests and 
recording scores, etc. School administrators typically spend their time 
coordinating major schoolwlde testing programs: overseeing distrlbu- 
tlon, administration, collection and checking of state-assessment 
measures, standardized testing, and/or minimum-competency (proficiency) 
assessment. (See Tables 7 and ,8 for the time administrators and class- 
room assistants spend annually on all aspects of testing In the two case 
study schools.) 
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CHAPTER 3 
USING ASSESSMENT RESULTS 

The results of tests and other assessment techniques can be used for 
many different purposes by educators In the schools. Nearly all 
educational testing and measurement texts Include long lists of these: 
diagnosing learners' needs, placing students In programs, monitoring 
students' progress, evaluating curriculum and Instruction, planning for 
school Improvement, reporting to parents, satisfying accountability 
requirements, and many others. Such lists outline the possibilities'. 
CSE's Test Use In Schools Study sought to Identify actual practices. Thus, 
both principals and teachers were asked how heavily they weigh different 
types of test results and Information from other sources In a variety of 
routine decisions and tasks. 

Figure 2, an example from the teacher survey. Illustrates the form 
these questions took. 

Figure 2 

Format of Survey Test-Use Questions for Teachers and Principals 
niustratioh from the Teacher Survey 



22. Whan I initiilty group or plica ttudants for instruction. h«r«'s 

how Importmt various soureas of information ara to ma: , 

(a) Pravious taacfwr's commants, o 1 S I I 
raports, gradas 4 3 2 1 0 

(b) Studanta' atandardizad 

tast scoras 4 3 2 1 0 

(c) Stu(kints' scoras on district 
continuum or minimum 

compatancy taats ; 4 3 2 1 0 

(d) Rasutts of plaeamant tMts 

^ includad with curriculum usa 4 3 2 1 0 

la) Rasulto of othar spaciaf 
\ plaeamant tasts 4 3 2 1 0 

(f) WuHs of tasts I maka up 4 3 2 1 0 

(0) K|y own olMarvatlons and 

siudants' classwork 4 3 2 1 0 



The same format was followed in the questionnaires for principals. As in 
the example, each question about a particular use of assessment elicited 
information about a range of test types and about other modes of 
assessment, e.g., observations and classwonK* ds well. Notice that the 
. test-type categories sjiven in these questions are identical with those 
employed in survey questions about students' testing time (Table 5 above). 
Recall that these were the test-type labels teachers and principals used 
recurrently, without prompting, during the open-ended, pre-survey 
interviews conducted in several school districts across the United States. 
It Is highly likely, therefore, that most survey respondents found them 
familiar and meaningful. 

Practically, the survey could not examine all the possible school and 
classroom uses of assessment results. Choices had to be made in order to 
keep questionnaires at a reasonable length. Pre-survey interviews played a 
major role in guiding these choices. One of these Interviews asked 
respondents to name all the achievement tests that they gave their students 
through the school year, then to describe what (if anything) they did with 
the results. The second interview form encouraged informants to discuss 
the major tasks and decisions their jobs routinely entailed as a typical 
school year proceeded; It ^en inquired about all the information that 
informed each task and decision. These interviews made it possible to 
Identify: (1) those tasks and decisions that teachers and principals 
considered to be major responsibilities in their respective jobs; and (2) 
those for which principals or teachers were Inclined to consult test scores 
or other assessment information. Thus, within space contraints, the survey 
questionnaires were able to focus on major tasks and decisions in which 
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test results were likely to be used. 

Below, the findings from the principals and teachers questionnaires 
are described and discussed separately, then supplemented with Information 
from fleldwork Interviews. 

A Wide Variety of As^^assaent Results Play a Role In School -Level tasks. But 
Teachers' Tests and Their Professional Judgpents Are Host Inwrtant . 

Principals described the Importance of different types of assessment 
results in eight, school -level tasks and decisions. Table 9 lists these 
and shows the percentages of principals who stated that the different types 
of assessment information were crucial or Important in each task. Table 10 
displays the same data in a different form: as the mean (or average) 
Importance rating principals gave each type of information for each. task. 

Notice that both tables report the use of five main types of 
assessment results: those that come from (1) standardized, norm- referenced 
batteries; (2) minimum competency (proficiency) tests; (3) tests referenced 
to district curriculum objectives; (4) teachers' classroom tests and 
assignments (unit or chapter tests, quizzes, finals, whether 
teacher-constructed or included with published curriculum materials); and 
(5) teachers' observations of and interactions with students and/or their 
professional judgments. In fact, however, principals were also asked to 
rate the Importance of other types of information for five of the eight 
tasks. Table 9 (Column F) shows which of these other types of information 
most principals considered crucial or Important for each of those five 
tasks, as well as the percentages who' did so. For the sake of simplicity, 

48 e 
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Table 9 



School -Level Uses of Test Results and Other Information 
(Percentages of Principals Reporting Use of This Information 
as Crucial or Important for the Specified purpose) 



Task or Decision 



Information Source 



ERIC 





A 


6 


C 


D 


E 


F 








ELEMENTARY 






Curriculum Planning 


78 


60 


65 


72 


88 




Assigning Students to. 
Classes 


47 


30 


38 


74 


84 


49a 


Teacher Evaluation 


16 


11 


25 


40 


mm «• 


100^ 


Allocating Funds 


28 


21 


29 




81 


77c 


Student Promotion 


51 


36 


48 


84 


96 


94d 


Informing the Public 


72 


38 


41 


42 


— — 




Communicating to Parents 


78 


56 


63 


98 


95 


92® 


Reporting to District 


81 


55 


58 


53 




mm m 








SECONDARY 






Curriculum Planning 


74 


75 


57 


63 


84 




Assigning Students to 
Classes 


72 


64 


45 


75 


80 


76^ 


Teacher Evaluation 


20 


15 


21 


43 




95b 


Allocating Funds 


24 


28 


21 


mm m 


94 


84C 


Student Promotion 


24 


48 


26 


84 


76 


96^ 


Informing the Public 


74 


63 


43 


, 47 




m mm 


Communicating to Parents 


79 


69 


45 


96 


94 


97f 


Reporting to District 


86 


72 


56 


60 







A « Results of standardized, norm- referenced batteries 

B = Results of minimum competency (proficiency) tests 

C « Results of district's, objectives-based tests 

D « Results of teachers' classroom tests and assignments 

E = Teacher' opinions, judgments, recommendations 

F « Various other sources, as follows: 

a = students' past classroom behavior 

b « observations of teachers' teaching * 

c = specific directions from district 

d » classwork throughout the year 

e « observations of the student ' 

f » student's report card grades 



— « Not asked 



4<i 
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Table 10 

Importance of Test Results and Other Information In School -Level 

Tasks and Decisions 
(Mean Ratings by Principals on a Four-Point Scale)* 

ELEMENTARY . 



Decision or Task 


A 


B 


C 


D** 


E 


Curriculum Planning 


3.01+ 
(.67) 


2.91 

(.7»:) 


3.04 
(.87) 


2.99 
(.07) 


2.94 
(.84) 


Assigning Students to 
Classes 


(.81) 


Uh 


Hh 


Uh 




Teacher Evaluation 


1.70 . 
(.76) ' 


1.53 
(.78) 


1.80 
(.93) 


1.68 
(.14) 


2.12 
(.97) 


Allocating Funds 


1.91 
(.87) 


1.89 
(.90) 


1.94 
(1.01) 


1.91 
(.03) 




Student Promotion 


2.65 
(.81) 


2.31 
(.96) 


2.38 
(.94) 


2.45 
(.18) 


3.05 
(.70) 


Informing the Public 


2.77 
(.90) 


2.47 
(.99) 


2.34 
(1.00) 


2.52 
(.22) 


2.31 
(1.05) 


Communicating to Parents 


2.91 
(.60) 


2.64 
(.98) 


2.67 
(.95) 


2.74 
(.15) 


3.43 
(.55) 


Reporting to District 


3.12 
(.68) 


2.^8 
(1.10) 


2.74 
(1.10) 


2.88 
(.21) 


2.62 
(.91) 



3.27 
(.64) 



1) 



3.08 
(.71) 

3.29 
(.67) 



3.45 
(.57) 



SECONDARY 



Curriculum Planning 

Assigning Students to 
Classes 

Teacher Evaluation 
Allocating Funds 
Student Promotion 
Informing the Public 
Ct&iuni eating to Parents 
Reporting to District 



2.83 


3.27 


2.95 


3.02 


2.76 


3.14 


(.67)- 


(.64) 


(*.82) 


(.23) 


(.75) 


(.70) 


2.77 


2.98* 


2.78 


2.84 


2.98 


2.99 


■(.77) 


(.87) 


(.87) 


(.12) 


(.73) 


(.79) 


1.63 


1.77 


1.84 


1.75 


2.39 


w •» «» «• 


(,.74) 


(.71) 


(.78) 


(.11) 


(.83) 




l*i73 


2.20 


2.06 


2.00 




3.34 


(.81) 


(1.13) 


(1.08) 


(.24) 




(.54) 


1.61 


2.58 


2.05 


2.08 


3.33 


3.46 


(.78) 


(1.28) 


(1.13) 


(.49) 


(.85) 


(.75) 


2.84 


2.92 


2.30 


2.69 


2.24 




(.80) 


(.1.03) 


(1.07) 


(.34) 


(1.05) 




2.91 


3.03 


2.55 


2.83 


3.56 


3.38 


(.58) 


(1.00) 


(.99) 


(.25) 


(.55) 


(.76) 


3.10 


3\l2 


2.92 


3.04 


2.53 




(.64) 


(.97) 


(.95) 


(.11) 


(.88) 





A « Standardized, norm-referenced test batteries 
B = Minimum Competency Tests 
C » District Objective-based Tests 
D » Average Required Tests 1A,B.C), 
E = Results of Teacher and Curriculum tests 
p - - 



= Teacher Opinions/Recommendations 

* M-j^Mnt scale: 4 p Crucial Importance - 1 - Unimportant or not used] 

+ Numoers in parentheses are standard deviations. , , , , n ^ 

** Numbers In parentheses are standard deviations of values in columns A, B and 

^' . .■ 50 
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these data are omitted in Table 10. 

As the tables Indicate, most schools appear to ground their actions 
upon several Information sources in all eight tasks or decisions. In 
general (Table 10), no one stands out as markedly more Important than all 
the others for most tasks. For almost every task, however, principals rate 
the results of teachers* classroom testing as more crucial or Important 
more often than the results of arty other type of paper-and-pencil measure 
(See Table 9). What is more, teachers' opinions, judgments, and 
recommendations clearly carry more weight than any type of test results in 
each of the eight tasks listed. 

Some types of measures listed on the survey are more formal tests: 
standardized, norm- referenced batteries, other kinds of minimum competency 
measures,* and test referenced to^Districts' instructional objectives. 
Compared to teacher-made tests and class assignments, great attention is 
usually given to their psychometric quality and their administration is 
usually marked by more formal or "official" testing arrangements and 
procedures. Usually, too, these tests are given in schools at the mandate 
of an agency beyond the school, e.g., by the district, the state or, even 
by the federal government as part of the requirements for a specially 
funded program. 

The results of these formal tests appear to make their greatest 
contribution in three school -level tasks: curriculum planning, communica- 
ting to parents about their children's achievement, and reporting to school 
district administrators. Conversely, formal test results are least 
important in evaluating teachers and in allocating funds within the school 

* In some states and district, standardized, norm- referenced measures are 
used as minimum competency or proficiency tests. 

51 
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for such things as personnnel, equipment, and materials. In secondary 
schools, formal test results, and especially the results of minimum 
competency or proficiency tests, also play a significant role in decisions 
about students' class assignments. Fieldwork indicates, for example, that ^ 
students' who fail to meet minimum standards on competency tests are 
sometimes assigned to special courses designed for remediation in the basic 
skills covered by the tests. 

Standardized, norm-referenced batteries seem to be the most 
influential of the formal required tests at the elementary level. However 
at the high school level, educators pay more attention to the results of 
minimum competency tests than to those of the other types of formal 
measures. 

The Results of Fofal Tests Are Deewed More Important In Schools Serving 
Students of Lower Socioeconowic Status (SES) . 

An earlier section (page 31) noted that students in lower SES schools 
do not spend more time taking tests than middle or upper-income pupils do. 
Furthermore, teachers' classroom uses of test results (to be discussed 
next) do not vary systematically or significantly with students' 
socioeconomic status. In schoolwide or school -level tasks and decisions, 
however, tests results do appear to have greater Impact and wider 
consequences in lower SES schools than they do in higher SES settings. In 
the former, principals report that more importance is accorded the scores 
of formal tests especially minimum competency measures and district 
objectives-based tests — in planning curriculum, deciding on students' 
class assignments, allocating school funds, and reporting on school 
achievement to the public-at-large, parents, and district officials. (See 
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Table 11 



Importance of Test Results for School Decision-Making 
In Schools of Higher and Lower Socioeconomic Status (SES)"^ 



HIGHER SES 



Standardized 


Minimum 


District (X)Ject1ve 


Norm- referenced 


Conv)etenc;y 


based or 


Decision Or Task Test Batteries 


Tests 


Continuum Tests 


Curriculuni Evaluation 


2.90 


2.95 


Z.o4 




(.52) 


(.71) 


(.92) 


Student Class Assignments 


2.49 


2.24 


2.10 


(.71) 


(.79) 


(.96) 


Teacher Evaluation 


1.d9 








(.72) 


(.74) 


(.81) 


Allocatino Funds 


1.85 

♦ • Vw 


1.85 


1.71 


( .83) 


/ 01 ^ 


V •oo) 


Student Promotion 


2.19 


2.49 


2. 27 




(.83) 


(1.04) 


(.95) 


Public Communication 


2.69 




&««^w 




(.78) 


(.96) 


(1.00) 


rofTiTiLin1(^dt1nQ to Parents 


2.80 




£•01 


(.56) 


(.94) 


(.84) 


Jteoortlna to District 


3.03 


0 OA 




(.73) 


(1.09) 


(.94) 








LOWER SES 


Purrlf^iil LBti Fval nation 


3.08 

W • WW 


0 1 Q 

^ o.io 


^ OQ 




(.78) 


(.59) 

% • w^ / 


(.83) 


Student Uass Assignments 


2.68 


2.0/ 




(.79) 


Q 03) 

\ X • WW / 


(.94) 


Teacher Evaluation 


1.95 


1 "Til 






(.84) 


(.72) 


(1.03) 


Allocating Funds 


2.00 


. 2.45 


2.18 


(.79) 


(.92) 


(1.00) 


Student Promotion 


2.45 


2.39 


2.17 




(.93) 


(.99) 


(.84) 


Public Coirmunlcatlon 


2.84 


2.93 


2.59 




(.90) 


(.97) 


(1.04) 


Communicating to Parents 


2.96 


3.26 


3.26 


(.57) 


(.78) 


(.51) 


Reporting to District 


3.11 


3.28 


3.11 


(.65) 


(.61) 


(.93) 



Average 
Requi red 
Tests (A,B,C) 

2.83 
2.27 
1.81 
1.80 
2.31 
2.46 
2.68 
2.90 
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* C4-po1nt scale: 4 « Crucial In|>ortance - 1 « Unlnportant or not used] 
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3.11 

2.65 

1.88 

2.21* 

2.34 

2.79 

3.16 

3.17 



Table 11, which shows the results for all principals, elementary and 
secondary together, divided Into higher and lower SES groups using 
school -level Indicators.) 

For ClassrooB Tasfcs. Teachers Place Host Weight on Their Observations and 
the Results of their Own Tests 

Teachers were asked to rate the importance of the results of various 
assessment types in four routine classroom tasks or decisions. The 
proportions of elementary and high school teachers who described different 
types of results as crucial or Important in each is displayed in Tables 12 
and 13. Table 14 portrays similar data in a different fb^: as the mean 
(or average) rating teachers gave each type of information^r each of the 
four tasks. Notice the Tables 12 and 13 divide teachers' responses by 
subject matter, while, Table 14 does not. 

These tables demonstrate that teachers do use test results of various 
types in making common instructional decisions. They also reveal quite 
clearly, however, that teachers place greatest trust in their own 
observations o.f students' class performance and in their personal , clinical 
judgment. Nearly every teacher reporting says that their "own observations 
and students' classroom work" are crucial or Important sources of 
information for initially grouping or placing students, in deciding to 
change students' placement or grouping, and in determining students' 
report-card grades. The great majority also give heavy weight to the 
results of their own, self-constructed test in each of these tasks. Among 
teachers in the elementary grades, "the results of tests included with the 
curriculum being used" play a major role in these same tasks. Notice, too. 
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Table 12 

Classroom Uses of Test Results ^nd Other Information: 
(Percentages of ELEICNTARY teachers surveyed reporting use of this infoilnatlon 
V as crucial or important for the specified purpose) 



Source Aind of Information 

Previous teachers' coninents» 
reports, grades 



Planning Teaching 
at Beginning of 
School Year 

Readi ng Math 
57 52 



Initial Grouping 
or Placement of 
Students 

Reading Math 
6^ 55 



Changing a Student 
from One Group or ^ * 
Curriculum to Another 



Reading 



Math 



Deciding on •>> 
Students' Re- 
port Card Grades 

Reading Math 



Students' standardized test scores 



Students' scores on district con- 
tinuun or minlmun conpetency tests 



57 
51 



54 



47 



57 



50 



52 



45 



55 



45 



53 

39 



17 
20 



16 
18 



4a> 



1^ previous teaching experience 



94 



94 



Results of tests included with 
currlculini being used 



78 



67 



83 



82 



75 



77 



Results of other special 
placement tests 



61 



56 



Results of special tests developed 
or chosen by my school 



56 



52 



42 



42 



Results of tests i make up 

\ 

\ 

FrTc'^ o>ii observations and students' 
L^ta cl assroom work 



>80 



. 96 



86 



97 



78 



99 



85 



99 



92 



98 



95 



98 56 



Table 13 



Classroom Uses of Test Results and Other Information: 
(Percentages of SECONDARY teachers surveyed reporting use of this information as crucial or important for the specified purpose) 



SourceAind of Information 

Previous weachers' comnents, 
reports, grades 



Plannlng Teaching 
at Beginning of 
School Year 



English 
28 



Math 
29 



Initial Grouping 
or Placement of 
Students 



English 
34 



Math 
40 



Changing a Student 
from One Group or 
Curriculum to Another 



English 

X 



Math 

X 



Deciding on 
Students' Re- 
port Card Grades 

English Math 



Students' standardized test scores 

Students' scores on district con- 
tinuum or minimum competency tests 



47 



48 



29 



30 



49 



47 



30 



36 



62 



53 



39 



36 



12 



8 



o 



previous teaching experience 



99 



97 



Results of tests included v^dth 
curriculum being used 



45 



35 



58 



43 



44 



31 



Resul ts of other special 
placement tests 



X 42 



26 



Results of special tests developed 
or chosen by school 



50 



31 



28 



34 



Resul ts of tests I make up 



87 



77 



92 



91 



99 



rrnr^ own observations and students' 
Liy ^ ilassroom work 

57 



99 



93 



99 



97 



99 95 

58 
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that teachers at both levels of schooling count their own, previous 
^ teaching experience as teachers most important for planning teaching at the 
beginning of a school year or semester. 

Mirroring findings for princip^als, these results show that teachers 
£UceJ^ss^phasis on formal test results that they do upon Information 
they gather themselves. Nevertheless, teachers do rate formal test scores 
as somewhat Important (Table 14) for initial planning and placement 
decisions, as well as in deciding later on to reassign individual pupils to 
a different group or curriculum. Fieldwork indicates that in the latter 
process, teachers frequently treat test results as a general indicator of 
the students' "capaWlities." Teachers interviewed said that they might 
examine standardized test scores, for example, to see if a poorly 
performing student has "low ability" or "isn't working up to his ability 
level." High-school interviewees sometimes explained that they checked the 
test scores printed on their class enrollment lists (as one put it) "to be 
sure they really belong in this class." 

The data in Tables 12, 13, and 14 hint that teachers rarely rely on 
only one type of assessment information as they go about making 
instructional decisions. Table 15 confirms th^t-^or many this is in fact 
the case. Not only do a good number of teachers routinely consult several 
types of assessment results in reach;fna each/dcision listed, they consider 
many as equally crucial or import^mt^This tendency is especially common 
among elementary teachers in the sample. 

Table 16 elaborates on this last point and, in effect, summarizes the 
key points of the discussion in this section. It demonstrates that except 
in planning their teaching at the beginning of a school year or semester. 
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Table 14 



Importance of Test Results and Other Information In Classroom 

Tasks and Decisions 

(Mean Ratings by Teachers on a Four-Point Scale)* 



Decision Area: 



Standardized 
Test 
Batteries 



Planning teaching at 
beginning of the 
school year 

Initial grouping or 
Placement of students 

Changing a student from 
one group or currlculun 
to another, providing 
remedial or accelerated 
work 

Deciding on report card 
grades 



2.53 
(0.74) 



2.51 
(0.74) 

2.52 
(0.79) 



1.62 
(0.76) 



District 
Contlnuim 
or Minimun 
Coirpetency 
Tests 



2.60 
(0.79) 



2.59 
(0.82) 

2.52 
(0.81) 



1.81 
(0.81) 



Tests 
Included with 
Currlcul un 

ELEMENTARY 



2.91 
(0.74) 

3.04 
(0.74) 



2.89 
(0.79) 



Teacher- 
Made 
Tests 



3.12 
(0.83) 

3.12 
(0.84) 



3.38 
(0.74) 



Teacher 
Observations/ 
Opinions 



3.39 
(0.76) 



3.58 
(0.78) 

3,66 
(0.72) 



3.69 
(0.72) 



SECONDARY 



Planning teaching at 
the beginning of the 
school year 

Initial grouping or 
placement of students 

Changing students from 
one group or currlcul im 
to another, providing 
remedial or accelerated 
work 

Deciding on report card 
grades 



2.22 
(0.84) 



2.28 
(0.92) 

2.52 
(0.95) 



1.36 
(0.66) 



2.38 
(0.93) 



2.46 
(0.98) 

2.59 
(0.56) 



1.45 
(0.64) 



2.48 
(0.92) 

2.67 
(0.93) 



2.29 
(0.96) 



3.04 
(0.87) 

3.27 
(0.76) 



3.65 
(0.62) 



3.59 

(G.€0) 



3.84 
(0.85) 

3.61 
(0.66) 



3.68 
(0.65) 



C4-point scale: 4 = Crucial Inportance - 1 « Uninportant or not used] 
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N Table 15 

Proportion of Teachers Who Report Considering Many Types of Assessment Infonnatlon 

Critical /Important for Given Tasks 



Nutter of Sources of 
Infonnatlon Given In 
Question on Survey 

Nurber of Sources 
Defined as "Many" 
for Purposes of 
this Analysis 

Proportion of 

El etnentary Teachers 

Who Indicated "mat 

at Least TTiis Many 

Functioned as Critical 

and/or Important 

for the Given Activity 

Proportion of 

High School Teachers 



PI anning 
Teaching at 
Begihning of 
School Year 



50% 



33% 



Initial 
Grouping 
or Placement 
of Students 



71% 



47% 



Changing 
Grouping 
or 

Placement 



62% 



49% 



Deciding 
on ^teport 
Card 
Grades 



40% 



20% 
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r Table 16 

Percentages of Teachers Who Consider One Type of Assessment Information 

To Be More Inportant,Thaci Any Other 



Task or Decision 



. ELEMENTARY 

% of % choosing 

Total teacher 

observati on/ judgment* 
as most Inportant 



SECONDARY 

% of % choosing 

Total teacher 

ob servati on/ judgnen 
as most Important 



Plannir;^ teaching 
at the beginning of 
the school year 



48 

9 



89 



68 



97 



Initial grouping or 
placement of studies 



25 



88 



36 



92 



Changing a student 
frOTi one group or 
curriculim to 
another 



27 



88 



25 



86 



Deciding on students' 
- report card grades 



21 



91 



10 



100 



* Percentages in these columns are the percentages of those teachers who did select one type 
of assessment as more inportant than all the others , rather than percentages of an 
teat hers 1n sample. 
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only small proportions of teachers count one source of assessment Informa- 
tion as more Important than all others for the routine tasks listed. And 
of those teachers who do report trusting one kind of Information above all 
the rest, from 86 to 100 percent say that the Information they trust mos 
Is their own observations and students' classwork {or, In the case of pla 
ning at the start of the year, their previous teaching experience). 

Fieldwork Interviews Support and Elaborate Survey Findings 

In the on-site interviews, teachers were able to describe with minimal 
constraints how they used test results and information from other 
assessment techniques. The purposes they most frequently cited were those 
that constitute their most essential, routine work: deciding what to teach 
and how to teach it to students of different achievement levels; keeping 
.track of how students are progressing and how they (the teachers) can 
appropriately adjust their teaching; and evaluating and grading students. on 
their performance (see Table 17). Clearly, these are the day-to-day 

routines of teaching. 

Less frequently, respondents mentioned using assessment results 1n. 
deciding to refer students who need special Instruction and to counsel, 
advise, and direct students. These are Important teaching responsibil- 
ities, but ones that serve to support or facilitate more basic Instruction- 
al work. 

Interviews also show that, unconstrained by the response format of the 
questionnaire, teachers still indicate that all types of paper-and-pencil 
measures they have available for assessing students' achleveiftnt, they rely 
most often on those that they themselves develop. As Table 17 shows, 
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Table 17 

Types of Tests and the Uses of Their Results by Teachers (Interv1e»< Data) 

(Cells show the nunber of times the 44 1nterv1ey*ed teachers freely cited each use 
for each type of test) 



USES 

Planning Instruction 

Referral /Placement 

Within Classroom Group- 
ing & Individual 
Placement 

Holding Students 
Accountable for Work, 
Discipline 

Assigning Grades 

Monitoring Students' 
Progress 

Counseling & Guiding 
Students 

Informing Parents 

Reporting to District 
Officials, School 
Board, etc. 

Conparing Groups of 
Students, Schools, etc. 

Certifying Minimum 
Conpetency 

TOTAL USE CITATIONS 

Explicit Statements 
of Non-use 



ABC 

24 21 10 

6 



3 
6 

8 

32 



10 
0 
0 
0 
0 



0 

14 18 



8 17 



18 12 17 



6 
1 
3 
1 

0 



0 
0 
1 
0 
0 



D 

3 

2 



5 
2 

0 

0 

0 

0 

0 



TEST TYPES 



E 

2 

0 



0 
0 
0 
0 



F 6 

3 13 

0 11 

5 4 



1 1 1 

0 



1 1 
1 2 



1 
2 



3 

0 
0 



1 1 

0 0 



101 74 63 16 11 19 33 



0 10 



H 
4 

1 



1 
1 

0 

0 

0 

0 

1 

10 
2 



I 
2 

0 



0 
0 

0 

0 

0 

0 

0 

3 
7 



Total 
82 

23 
61 

13 

66 
51 

22 

2 

6 

3 

1 

330 
21 



erJc 



KEY: 



A « Teacher Constructed 
B = Teachers* Other Major Assignments 
C « Currlculim Embedded 
D « School /Department/Grade Level 
E « Commercial Diagnostic 



F * District-Objectives Based 
G = Standardized 

H « MinimLffn Competency 
I « Statewide Assessment 
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teachers freely cited more uses for such assessment tools than for any of 

the other types. The teachers' Interviewed universally reported that their 

own perceptions' of children's performance in class, or homework, etc. were 

an Important factor in all their judgments and decisions; thus the 

frequency with which these were mentioned is not included in Table 17. 

Fieldwork findings, then, are completely consonant with survey results 

despite differences in the el ici tati on procedures < 

Fieldwork interviews also help to explain some of the reasons why 

teachers feel that the results of one type of test, or even of tests in 

general, cannot be trusted without reference to their everyday experience 

with learners. The following quotations are illustrative: 

" I don't rely heavily on a lot of the test scores 
because I find that... some students are test takers 
and others are not... some students can handle the 
format, ihe time limit, (but In many cases) students 
are capab\e of more than the test scores show. 

* I hate to say it, but I'd say about a third of these 
student don't give it their best shot. They feel 
there's nothing in it for them. There's no grade for 
it; there's no use for it so they don't care. 

* If I see there are certain kids having trouble I may 
look at their folders and find out (more) about 
them. But I try not to be swayed by somebody else's 
judgment...! may get more out of them by what I'm 
telling them and trying to motivate them to do better 
than they've ever done before. 

You can't count on a score on one test too heavily. 
The kid could be sick or tired or just not feeling up 
to doing it that day. Maybe his parents had a fight 
the night before. Maybe he doesn't test well. 

It seems, then, that part of what teachers "know" is that students can 

vary as test takers and that a variety of situational factors can Influence 

students' test performance. Under these circumstances, teachers appear to 
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reason, 1t is better to rely upon a variety of Information sources — and 
especially on one's day-to-day experience with students in the variety of 
task and performance contexts that routinely recur In the classroom. If 
principals share this outlook i it may explain why they, too, routinely 
count on teachers judgments, opinions, and recommendations (Tables 9 and 10 
above) . 
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CHAPTER 4 

ADMINISTRATIVE LEADERSHIP: MONITORING AND SUPPORTING ASSESSMENT 

A growing research literature demonstrates the Importance of 
district and school leadership In the Implementation and maintenance of 
particular education Innovations, programs, and practices (e.g., Berman 
& McLaughlin, 1977; Bank & Williams, 1981; Edmonds, 1979). In view of 
these findings, the Test Use in School Study sought to describe how, and 
how regularly, district and school administrators play leadership roles 
in local achievement assessment. 

Exploratory fieldwork suggested that administrators' assessment- 
related activities tend to fall into four general categories and to 
include both monitoring and supporting functions. The four categories 
include: 

(1) monitoring testing checking to see that 
appropriate assessment practices are followed. 

(2) linking tests results with instruction-- 
reviewing test scores, examining their imp! ica- 
tions for Instruction, communicating these 

to school staff, and monitoring instruction 
to assure that it attends to the areas that 
scores suggest should be emphasized; 

" ( 3^) pTOvrdfng "rtaf f "geveTdjfnfe'rit "^^^ 

assessment and test use by initiating in-service 
training and informational sessions. 

(4) facilitating routine classroom assessment 
initiating and maintaining techno iogica'i and 
organizational arrangements that reduce teachers 
time on testing. 

Fieldwork also indicated the range of ways in which district and school 
administrators commonly carry out each of these leadership roles. In 
addition, it confirmed that principals usually have much more 
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reliable knowledge about their district's policies and practices than 
classroom teachers do. 

CSE's national survey took these findings Into account. Question- 
naires examined the four types of activities listed above; specific 
questions and response choices were generally derived from the field- 
work. Questions about the role of district administrators were directed 
to principals, rather than teachers. Both principal and teachers were 
asked to report on certain school -level leadership activities. 

The results of this inquiry are described and discussed below. 

District Testing Prograws Are Closely Honltored; Routine ClassrooB 
Assessaent Is Wot . ^ 

As Table 18 shows, most principals say that their district adminis- 
trators closely monitor dlstrictwide testing programs to be sure they 
are properly carried out. While fewer thar, half at both levels of 
schooling find that such oversight is regular or routine, many others 
note that it occurs "fairly often." Only 25% of the elementary 
principals responding and 32% of the in secondary principals report that 
their districts rarely or never check up on district testing. 

In sharp contrast, there appears to be very little monitoring of 
routine classroom assessment. Administrators in most schools do not 
systematically review and critiqiie the tests that their teachers 
construct. This practice is regular or frequent in only 13% of the 
elementary principals' schools and in 30% of the secondary principals'. 
(Administrative review of high-school final examinations, fieldwork 
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Table 18 
Monitoring Achievement Testing 
(Percentages of Principals Reporting the Regul.irUy of Each Activity)* 



Elementary 



Secondary 



DISTRICT ADMINISTRATION ... 

Conducts observations and/or 
requires reports to see that 
an aspects of the district 
testing program are properly 
carried out 



Routinely Often Rarely Never 



44. 



30 



19 



Routinely Often Rarely Never 



38 



30 



20 12 



THE SCHOOL ADMINSTRATION . . . 

Requires teachers to turn 
in copies of the tests they 
construct to be reviewed 
or critiqued 



7 26 



60 



12 



0 



18 



35 3B 



Requires that teachers turn 
in the scores or grades of 
the tests and/or assignments 
they routinely give in their 
c1assroj?fns {e'.g., unit tests, 
chapter tests, etc.) 



21 



12 



36 



32 



18 



15 



35 32 



* Principals indicated the regularity of each activity freer ::^ng the following response 
choices: 4 = happens regularly or routinely (i.e., on a ivitematic, periodic basis as 
part of routine procedure; 3 « is not re^lar or routine but happens fairly often; 
2 = is not re^laV or routine and happens rarely; 1 « does not happen at all. 
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suggests, may account for the difference in these percentages.) 

Monitoring of teachers' test results, It appears, is 'only slightly 
more common than the practice of reviewing their tests. A mere third of 
the principals at each level of schooling make it a routine or frequent 
requirement for teachers to turn in students' scores or grades on 
classroom tests and assignments. When they do so, furthermore, it may 
not be for oversight purposes, fieldwork found one elementary school 
principal who did examine all the reading and math' unit- test scores of 
each of his thirteen teachers' pupils in order to "keep track of how 
things are going and identify problems that should be discussed." 
Elsewhere however, principals gathered students' scores on commevical , 
curriculum-embedded tests on a pro forma basis and never examined them. 
They were used only to complete forms in compliance with evaluation 
requirements for a special program. In addition, several high school 
adminstrators mentior^ed collecting students' grades on final exams "in 
case there are any C(f>mpla1nts from parents about the course grades" or 
"In order to protect! the teachers." 

1 

In summary, theiresults in Table 18 indicate that most school 
administrators do not check up very often on teachers' test designs, 
scoring procedures, or\ grade distributions. Rather, they appear to 
trust their teachers' pr^ofessional competence of teachers in assessing 
student achievement. The next chapter offers further evidence to 
support this proposition. \ While few review teachers' assessment 
procedures often, over 80% >,of the princiapls studied express confidence 
that teachers construct tests of high quality (Table 25 , page 80). All 
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this Is esbeclally worthy of note given the importance generally accord- 
\ ed the resiKts of teac tier-made tests and assignments in a wide variety 
of school and classroom tasks (Tables 9 through 14 in Chapter 3). 

Testing And Instruction Are Not Well Linked In Many Districts and 
Schools . 

Evidence in the previous chapter (Tables 11 and 13) indicates that 
both principals and teachers tend to rely heavily on the results of many 
different types of tests as they go about planning curriculum and 
instruction. Nevertheless, it appears thav a good many district and 
school leaders are doing less than they could to facilitate the use of 
test results in the planning and teaching process. 

Tables 19 and 20 below list several very basic activities that 
district and school leaders can undertake toward linking test results 

< 

with curriculum and instruction. As a first step (Table 19), districts 
can arrange testing and test scoring such that results are returned to 
schools at a time and in a format which permit them to be useful and 
used. Then, once the scores arrive in a school (Table 20), administra- 
tors there can initiate meetings with teachers to examine their implica- 
tions: to identify and highlight the subjects and skills that seem to 
require greater (or less) teaching emp»jasis. If principals' perceptions 
are correct, however, these are consistent, routine procedures in only a 
minority of settings. 

Over half (54%) of the high-school principals and nearly as many 
elementary-school administrators (47%) say that their oistricts rarely 
or never return test results in ways that make them useful for curricu- 
lum planning. Those who find that their districts do so regularly and 
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Table 19 

Linking Test Results with Instruction: District Leadership 
(Percentages of Prfhcipals Reporting the Regularity of Each Activity)' 



THE DISTRICT ADMINISTRATION .., 

returns test scores in such 
a way that I can use them to 
decide on the skills and 
content we need to work on 
in our school 



Elementary 
Routinely Often Rarely Never 



30 



23 



22 



25 



Secondary 
Routinely Often'^^rely Never 



18 



28 



28 26 



observes ny work, reviews 
school plans, and/or re- 
quires written reports to 
be sure the school is 
enphasizing the skills 
or content areas that 
test scores show need 
enphasis in our school 



32 



34 



23 



11 



26 



29 



38 7 



establishes specific test 
score goals for our school 
to meet 



20 



16 



19 



46 



19 



19 



30 32 



See footnote to Table 18 for a detailed description of these response choices. 
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Table 20 

Linking Test Results with Instruction: School Loadership 
(Percentages of Principals and Teachers Reporting the Regular1';y of Each Activity)^ 



THE SCHOOL ADMINISTRATION .., 

meets with Individual teach- 
ers, departments, and/or grade 
levels to review test scores 
in order to identify skills 
or content areas that need 
extra emphasis/ less atten- 
tion 



Elementary Secondary 
Routinely Often Rarely Never Routinely Often Rarely Never 



34 

(37) 



48 
(22) 



17 
(19) 



1 

(12) 



25 

(14) 



51 

(19) 



21 3 

(36) (31) 



observes teachers, reviews 
their plans, and/or re- 
quires written r|ports to 
be sure they are giving 
enphasis to the skills 
content, etc. that test 
scores show their students 
heed to work on 



53 
(31) 



30 
(24) 



17 
(24) 



0 

(21) 



40 
(22) 



40 
(19) 



17 2 
(31) (28) 



considers students' test 
scores in evaluating teach- 
ers and/or establishes test 
score goals for teachers 
to meet 



V/ 



\ 



4 

( 6) 



8 

( 8) 



32 

(15) 



56 

(70) 



1 

(12) 



10 
( 5) 



39 50 
(10) (72) 



Teachers' response are shown below principals in parentheses. 

See footnote to Table 18 for a detailed description of these respons choices. 
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systematically comprise only small proportions of the sample: 30% at 
the elementary level and 18% at the secondary level. 

Most principals claim that they do better in reviewing and 
analyzing the test results with their teachers. Some 84% of those in 
elementary schools respond that they meet with teachers regularly or at 
least fairly often to discuss what test scores mean for instruction. 
Among the high school principals, 76% reply in the same way. But if 
their reports of district procedures for returning results are correct, 
many may be discussing scores that are outdated or otherwise 
Inappropriate. Alternatively, principals may be using different 
standards to judge what is "routine" and "often" in describing their own 
behavior and their districts'. Another possibility is that some 
principals, viewing the use of test data in instructional planning as a 
desirable practice, have exaggerated the frequency with which It occurs 
in their schools. 

Teachers' observations (Table 20) support this last hypothesis. In 
general, they assert that meetings to link test information with in- 
structional plans take place less regularly than principals maintain 
that they do. Assuming the salience of such meetings for teachers is 
the more important (since it is they, after all, who musi put any in- 
structional plans into effect), it appears that test-based planning 
occurs on a regular, periodic basis in about 37% of the elementary 
teachers' schools and 14% of the high-school teachers'. In another 22% 
of the former and 19% of the latter, it seems to occur fairly often. 
(Refer to the figures in parentheses in the first line of Table 20.) 
While these percentages are not insubstantial, they do suggest that 



7i 



- 67 - 



many school leaders could be deriving greater value from their test 
scores than they currently are. In addition, many leaders at the 
district level could be doing more to facilitate this process by 
getting scores Into principals' and teachers' hands In a timely and 
useful fashion. 

Following through to be sure that test-based currlcular and 
teaching plans are Implemented Is a next, fundamental step In linking 
testing with instruction. Thus, district administrators can visit 
schools, review their plans, and/or require written reports to be sure 
schools are emphasizing the skills or content areas that test scores 
show are in need of extra attention (Table 19). School administrators 
can take similar steps with classroom teachers (Table 20). Somewhat 
ironically, it appears that both district and school leaders pursue 
these monitoring procedures more regularly than they make test results 
and their implications accessible and clear to teachers. (Compare the 
first and second lines of Table 19 and Table 20. Once again, note the 
differences in principals' and teachers' reports in Table 20.) 

As yet another step in holding their staff members accountable for 
test-based curricular and instructional plans, administrators can 
establish specific test-score goals for schools and teachers to meet. 
They can also take students' test results into account in teacher 
evaluation. Table 20 reveals, however, that these step:» are rarely 
taken at the school level. Only 12% of the elementary-:>chool principals 
and 11% of those in secondary schools say that they regularly or 
frequently set test-score goals for their teachers to meet or consider 
test results in teacher evaluation. As the next chapter demonstrates 
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principals simply do not deem It appropriate to assess teachers' 
competence on the basis of their students' test performance. Most rely 
on their own observations of teachers work in the classroom for this 
purpose (Table 25, page 80). 

Administrators at the district-level ,^9n the other hand, are more 
likely to set test-score benchmarks for schools. Over all, 36% of the 
principals In elementary schools and Z3% of those In high schools report 
that their districts do so routinely or often (Table I'Q.) This 

practice, survey results also suggest, occurs more commonly In districts 

V 

serving lower socioeconomic gi^oups than In those serving the well-to- 
do. Only 10% of the elementary and secondary principals In the highest 
socioeconomic districts sampled say that they routinely face district- 
established test-score goals. Among those In the lowest socioeconomic 
districts sampled, however, the figure is 40%. ^ 

Reviewing all the "routinely" and "often" coiumns in Tables 19 and 
20, it is evident that roughly a half to two-thirds of the principals' 
districts and schools manifest some concern that test scores be used in 
curricular planning and instruction. Nevertheless, it is also apparent 
that comparatively few administrators routinely take steps to be sure 
that test SCO readily accessible or routinely review those test 

scores with their faculty members. More, but still relatively small 
percentages of administrators, routinely check to see that test- score- 
based curricular and instructional decisions are actually carried out in 
classrooms. Even fewer choose to hold schools and teachers accountable 
for such decisions by projecting test-score objectives for them to 
achieve. Considering test results in evaluating teachers, moreover, is 
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generally avoided. All of this plus certain apparent inconsistencies 
in principals' reports and the divergence of teachers' and principals' 
— suggests that in most districts and schools the links between testing 
and instruction are very loose indeed, especially at the secondary 
level. Fieldwork during the Test Use in Schools Study supports this 
finding, as does on-site research conducted in other CSE projects (e.g., 
Bank & Williams, 1981). 

Teachers Average Seven to Eight Hours a Year la Assesswent Inservtce; 
Explanations of How To Adwinlster Tests andTof T^st Results Are the Most 
CoHBon Topics . 



Studies have repeatedly revealed that teachers receive little pre- 
service training in testing and measurement (e.g., Coffman, 1983; Yeh, 
1978). This is one reason why their inservice activities in assessment 
are of special interest. What is more, it appears that staff develop- 
ment is a critical factor in districts' establishment of systems to link 
testing-evaluating instruction linkage systems (Bank & Williams, 1981). 
Districts' and schools' staff development and informational activities 
in the area of assessing student achievement assessment, therefore, were 
given considerable attention in the CSE national survey. 

Principals' responses show that district-sponsored staff develop- 
ment in assessment occurs routinely or often in 61% of their elementary 
schools and S7% of their high schools. School -supported inservice takes 
place, they collectively report, only slightly less regularly 
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(Table 21.) Allowing teachers extra pay or time away from the classroom 
to help develop tests and related materials appears to be a somewhat 
less widespread practice. Some 41% of the elementary and secondary 
principals say that it happens routinely or frequently in their 
districts. 

These figures suggest that most districts and schools give 
considerable attention to training teachers in assessment and to a 
lesser degree, utilize teachers' skills in local test development. Once 
again, however, teachers' reports present a more modest picture. The 
elementary teachers surveyed estimate that they had spent, on the 
average only six hours in district or school -suported inservlce training 
on student assessment during "the last two years." Secondary teachers 
judge that they had spent an average of only five hours thus engaged in 
the same period. During those two years, meetings to select tests, to 
construct them, or to help formulate testing policies consumed another 
eight hours for elementary teachers and an additional eleven for 
high-school instructors. (See Table 22.) All told, then, it appears 
that teachers average about seven or eight hours a years on all 
district-and school-sponsored Inservlce activities connected with 
assessment. Of this total, teachers spend about two-and-a-half or three 
hours expanding their assessment skills. 

These estimates should be taken as extremely rough, based as they 
are on teachers' recollections over two years. They do, however, put 
principals' estimates of district and school support in perspective. If 
local educational agencies are devoting a great deal of time to 
developing or employing teachers' assessment skills, that time is not 
particularly salient for most teachers. 
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Table 21 



Supporting Assessment Through Staff Development and Release Time 
(Percentages of Principals Reporting the Regularity of Each Activity)* 

Elementary Secondary 
Routinely Often Rarely Never* Routinely Often Rarely Never* 

THE DISTRICT ADMINISTRATION ... 

provides speakers, workshops, 
printed material, etc. in an 
effort to help teachers expand 
and update their skills and 
understanding in the area of 
student assessment 

b 

provides released time and/ 
or extra pay for teachers 
to help develop tests (or 
curriculun materials that 
include tests) 



THE SCHOOL ADMINISTRATION ... 

brings in speakers, workshops, 
printed material, etc. to help 
teachers update and further 
develop their skills and under- 
standing in the area of 

student assessment 22 32 36 10 9 35 47 9 



* See footnotes to Table 18 for a detailed description of these response choices. 
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26 35 26 13 22 35 32 11 



13 28 25 34 12 29 33 26 
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Table 22 

Teachers' District and School In-Service Time on Assessment 
(Reported In Average Number of Hours Spent Over the Last Two Years)' 



El ementary Secondary 
Teachers Teachers 

Meetings within ny district or school 
to select or construct tests and/or 

to help establish testing policy 8 11 



District or school supported Inservlce 
training on topics related to student 
assessment (testing, other techniques) 



* The figures given here are rounded to the nearest hour. They are based on teachers' 
responses to the following direction: "For each activity below In which you have 
participated, indicate the approximate TOTAL nunber of HOURS you spent in the last 
two years." 



\ 

\ 
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Table 23 elaborates on these findings, showing how teachers spend 
their staff development time. For the most part, they attend explana- 
tions of state, district, or school test results; receive directions on 
how to administer required tests. Inservice training that would help 
teachers develop or expand classroom assessment skills, the table shows, 
tends to occur far less frequently. Thus, for instance only about a 
fifth of the teachers in each category report receiving instruction in 
"how to construct or select good tests." Information on alternatives to 
testing is provided just as rarely for secondary teachers, although some 
54% of the elementary teachers do report staff development on this 
topic. Training in the use of test results to improve instruction is 
evidently provided for 35% of the elementary teachers and about 20% of 
the secondary teachers sampled. 

Two other §taff development activities on the list can be 
construed as aimed directly at improving students' test results, "How to 
tie what is taught more closely to the skills, content covered on 
required tests" and "Presentation of published materials designed to 
prepare students for particular tests or to^improve test- taking skills." 
From a quarter to a third of the secondary teachers and 40% to 50% of 
elementary teachers have received training In these areas. 

In summary. It appears that districts and scho^^s are doing much 
less than they could to build teachers' competencies in achievement- 
assessment. This is especially true for high-school teachers. 
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Table 23 

Teachers' Participation In Staff Developront 

(Percentages of Teachers Who Report Joining In 
At Least. One Session on Various Topics 
During "the last two years") 



Topic 



(1) Analysis and explanation of state, 
district, or school test results 



(2) How to administer tests required by 
state, district, and/or school 
(procedures to follow, etc.) 



Elementary 
84 



78 



Secondary Secondary 
English Math 



70 



54 



60 



46 



(3) How to Interpret and use results of 
different types oft tests (e.g., norm- 
/referenced and criterion-referenced 
^. ' tests and their appi 1 cations) 



59 



35 



34 



(4) Alternative ways (other than tests) 
to assess student achievement 



54 



25 



21 



(5) How to tie what is taught more closely 
to the skills, content covered on 
. required tests 



50 



37 



25 



(6) Presentation of published materials 
designed to prepare students for 
particular tests or to Improve 
test- taking skills 



41 



32 



29 



(7) Training in the use of test results 
to inprove Instruction 



35 



21 



19 



(8) How to construct or select 
good tests 



20 



23 



18 
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Resources To Facilitate Routine Classroow Assessaent Are Mot Widely 
Available; But !lhere They Are Avail able. They Are Used . 

Survey and fieldwork results discussed in Chapter 2 demonstrate 
that teachers spend considerable time constructing, grading, and 
recording the results of their own tests and assignments. 
Administrators can help teachers reduce this time by initiating and 
supporting technological and organizational arrangements that facilitate 
their testing work. Among those that fieldwork found to be available 
were banks of test items, con^juteri zed test scoring and analysis and, of 
course, paid paraprofessionals or volunteers to assist teachers in 
reading and grading tests and assignments. In addition, fieldwork 
suggested that some principals provide special time and support for 
teachers to develop tests that they can use in common with classes in 
the same grade level, subject, etc. 

While fieldwork and questionnaire piloting indicated that this was 
a reasonable list of resources to investigate in the national survey, 
survey reports show that three of the four are Mnavailable to large 
proportions of survey respondents (See Table 24). The exception, of 
course, is "other teachers with whom I plan and develop tests or other 
evaluation assignments," but only about a quarter of the elementary- 
school teachers and a similar fraction of the secondary-school teachers; 
report taking advantage of this resource aTT&^st monthly. Some 45% of 
the secondary teachers say that they construct ^sts with others a few 
times a year, and fieldwork suggests that this often occurs as teachers 
in the me department conjointly devise mid- term and final exams. 
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Table 24 
Available Resources for Testing 
(Percentages of Teachers Reporting) 



AVAILABLI 



Resource 



It^ banks of test questions 
upon wh'ch I draw in 
making up n^y tests. 



NOT 
AVAILABLE 

71 

51 



I 

Not Used 
4 
8 



Used Once 
To Several 
Times/Year 

8 

24 



I 

Used at Least 
Once/Month 



16 Elementary 
16 Secondary 



Other teachers with whom I plan 
and develop tests or other 
evaluation assignments. 



37 
21 



12 
10 



26 
45 



24 Elementary 
24 Secondary 



Someone who helps me read, 
grade, or correct 
tests and assignments. 



69 
70 



6 
5 



4 
4 



21 Elementary 
21 Secondary 



Quick, conputerlzed 
scoring and analysis 
of tests 



64 
58 



2 

16 



30 
22 



4 Elementary 
4 Secondary 



% 
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Computerized test scoring and analysis Is used a few times annually 
by a quarter to a third of both the elementary and secondary teachers 
sampled. Fleldwork Indicates that this probably reflects the use of 
small, on-site optical scanning machines for scoring mull^lple-cholce and 
similar "objective" tests. The number of districts and sctio.ol s with 
more sophisticated equipment that analyze students' errors is'^stlll 
quite small. Some districts, however, have developed computer programs, 
for scoring unit and chapter tests and simultaneously analv'zing 
individual students' strengths and«weakness on the skills they cover. 

A final point: in general, nearly all those teachers who have 
access to the resources listed indicate that they use them at least 
sometime during the school year. 
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CHAPTER 5 
PRINCIPALS' AND TEACHERS' 
PERCEPTIONS AND BELIEFS ABOUT TESTING 

Previous chapters have focused on what teacher and principals report 
that they do in assessing students' achievement, in using assessment 
results, and in monitoring and supporting assessment. Here, attention 
shifts from what teachers and principals do in assessment to what they 
perceive, believe, and value as they do it. 

Three complementary objectives shaped CSE's exploration of principals' ' 
and teachers' viewpoints on testing. One was to elaborate and clarify, 
confirm or disconfirm the values and beliefs suggested by principals' and 
teachers' assessment practices. A second objective was to gather their 
perceptions of current testing trends and policies and of how these are 
affecting the schools. In the widespread debate over testing and its 
uses, administrators and teachers in the schools have had little direct 
voice. Here was an opportunity to solicit their views. A third objective 
was to examine relationships between assessment attitudes and activities: 
to learn whether certain sets of beliefs seem to co-occur with and 
"explain" certain practices or, on the other h^i^d, whether particular 
practices (in staff development, for>example) seem to coincide with and 
account for particular sets of beliefs. Such relationships could point the 
way toward policy and action in local school districts and schools. 

Toward these end*;, the survey questionnaires presented principals and 
teachers with sixteen statements and asked them to indicate strong 
agreement or agreement, disagreement or strong disagreement with each. 
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The statements for principals and those for teachers varied slightly in 
phrasing, taking into account differences in their respective roles. 
Nevertheless, both forms of the questionnaire co\ ered identical topics: 
(1) the quality of achievement tests; (2) their value or usefulness; (3) 
effects of testing on the school; (4) the fairness and desirability of 
minimum competency (proficiency) testing; (5) educators' accountability for 
students' test results; and (6) the importance of testing as a local 
educational issue. 

Respondents' perceptions and bel iefs regarding the first four issues 
evolved as especially relevant in later analyses. They are emphasized in 
the discussion below; their relationships with other study findings are 
described in the next chapter. Viewpoints pn issues (5) and are 
mentioned briefly in this one. As in previous sections, information from 
fieldwork interviews serves to supplement and elaborate the survey 
resul ts. 

Principals: A Pro-Testing Perspective 

Testing appears to be a central issue in the professional lives of 
most of the principals studied'. Nearly two thirds report that it receives 
"a good deal" of discussion in their districts. What is more, a 
suSstantial majority seem to approach their discussions with a highly 
favorable view of tests and testing. (Refer to Table 25.) 

Principals judge that the quality of tests Is generally high . Ei ghty 
percent or- more of those who responded apply this judgment to tests that 
accompany published curriculum materials, to tests developed by their 
districts, and to the tests constructed by the teachers in their schools. 
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Table 25 

Principals' Views on Testing and Related Issues 

(N « 221) 



Issues and Items 



Percentage of Principals 
in Agreement 



Elementary 



les jLing As A Local Issue 

Testing is an issue that is discussed 
a great deal in our district 

\ 

Quality of Tests 

The quality of tests that come with published 
curiTiculum materials is generally high 

TWf^uality of our district-developed tests is 

generally good *- 

The teachers in my school develop tests of high 
quality , 

Standardized tests are fair for most students 

Value, Usefulness of Testing 

Test score are a fairly good Index of how ell 
a school is doing 

Student test scores can be used to evaluate teachers' 
effectiveness or competence 

ERIC ^ ^ 
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86 
84 

79 

82 



68 
32 
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Table 25 (conti 

Issues and Items 



The pressure that required testing exerts upon me 
and the teacher in my school has a generally 
beneficial effect 

"As a result of minimum competency testing (and 
similar programs), parents are contacting the 
school .. .more frequently or in greater numbers 

Desirability Fairness of Proficiency Testing 

Hinimum comptentency/proficiency tests should be 
required of aVT^ students for promotion at cer- 
tain grade Vevels and for high school graduation 

Minimum competency/proficiency/functional literacy 
tests are generally fair for all students 

Effects on the School 

In the last five years, the amount of testing 
required by our district, state or federal . 
program(s) has increased dramatically 

As a result of testing programs (for minimum 
comptency, etc.), more time is being spent 
on reading/English and math instruction in 

, our school 

The amount of time that is given to required 
testing and the preparation for It In my 
school is too great 
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Percentage of Principals 
in Agreement 
Elementary Secondary 



62 
56 

58 
58 

68 

71 
31 



62 
54 

70 
72 

75 

76 
26 
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Table 25 (continued) 



Issues and Items 



Percentage of Principals 
in Agreement 
El ementary Secondary 



As a result of testing programs (for minimum 
competency, etc.), more time is being spent 
on reading/English and math instruction 
in our school 



71 



76 



The amount of time that is given to required 
J testing and the preparation for it in 
school is too great 

Accountability For Test Results 

Schools should not be held accoutable for 
their students' scores on required or 
standardized achievement tests 

Schools should not be held accountable for 
their students' scores on minimum 
competency/proficiency/functional 
literacy tests 



31 



26 



37 



30 



30 



21 
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A similar proportion (82%) concludes that standardized tests are fair for 
most students. 

Unfortunately neither the survey nor project fieldwork was able to 
explore exactly how principals arrive at these judgments. Principals' 
broad confidence in test quality, however, is worthy of note in itself. It 
can help to explain their regular use of test results in a variety of 
routine tasks (Tables 9 and 10, pages 43 and 44), as well as their general 
belief in testing's validity and value (discussed next). Later, as the 
policy implications of this study are examined, principals' confidence in 

test quality will be cited again. 

¥'iOst principals see testing as valid and valuable . Principals, we 
have seen, rely on test scores most heavily for planning curriculum and 
(especially) for reporting school achievement to district officials, 
parents, and the general public. These uses can follow from district 
directives, public expectations, and other forces beyond principals' 
control. Be that as it may, most principals seem comfortable using test 
results in these ways. On the whole, they believe test scores accurately 
reflect their schools' performance, and the." generally see testing as an 
asset. 

By an overwhelming majority, principals reject the view that schools 
should not be held accountable for their students' test results. (See 
Table 25, "Accountability."). They appear to accept that it is what goes 
on in school and not, for instance, students' native abilities, their 
parents' support, or the community environment that is primarily 
responsible for how student do on tests. 

In a consistent set of responses, two thirds of the elementary- school 
principals and three quarters of those in high scools find that test scores 
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provide "a fairly good index of how a school is doing." As one California 

high- school principal explained in an interview: 

I'm not a believer that test scores tell all. Many 
factors contribute to outcomes and they're not all 
revealed in test scores. But they are important, are 
indices. They're something we should take a look at 
among other data... Like with our [standardized test and 
state assessment] results, I keep a running tally of 
the means and of where we are, so that I'm aware of the 
progress and of where our students may have had some 
difficulty. And we share that with the math and 
English departments, particularly, and with the rest of 
the staff. 

At an Iowa high school, the principal volunteered a similar perspective: 

I don't know that test results per se would change 
specific instruction much, but if year after year after 
year we had a department rating low, we would certainly 
look at several things. We'd want to talk to the 
people [in that department] to see what the problem 
is. 

These remarks reflect a qualified, or cautious, acceptance of test 
scores as "indices" of school performance. Fieldwork suggests that such a 
stance is common among both elementary and high-school administrators: It 
may well underlie their questionnaire response. 

While most principals maintain that test results reflect overall 
school performance, many fewer believe that individual teachers can be held 
accountable for them. Only 32% of the elementary-school principals 
conclude that "test results can be used to evaluate teachers' effectiveness 
or competence." Among the high-school principals responding, 49% agree. 
Recall, however, that principals at both levels claim that they in fact 
place little emphasis on test reults in teacher evaluation. In general, 
they tend to trust their own observations of their staff's teaching 
skills. (Again, refer to Table 9, page 43.) In some cases, cf course, 
administrators who would use test scores to evaluate teachers literally 
cannot do so. As a result of district policy or an agreement; with 
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teachers' representatives, they never receive classroom-by-classroom break- 
downs of students' test results. But many seem to concur with the views of 
an elementary-school principal who argued: 

You can't evaluate teachers from the office. You need 
to be In the classroom and be there frequently. Low 
[test] scores could mean we're not providing the 
supplies and materials. They could mean working 
conditions are a problem. It could be the types of 
students they're getting. It could be me. There are 
too many factors to say, "the scores are low, therefore 
the teacher is ineffective." 

This way of thinking emphasizes that it is the school as a whole -- and not 
the individual classroom teacher — that produces test results. 

For many principals the value of testing extends beyond scores and 
their uses to the influence testing has on the school community. Among 
respondents at both levels of schonling, 62% find that testing requirements 
exert a beneficial pressure on their teachers and on them. This lends 
support to those contemporary school reformers who suggest that stiffer 
testing requirements will help raise educational standards. 

At least one type of testing requirement seems to influence many 
parents' behavior. In most states, laws creating minimum competency 
(proficiency) testing also specify that parents be informed of their 
children's results. Districts and schools routinely encourage parents to 
discuss these results with school officials, and some schedule conferences 
with parents whose children have failed to meet minimum standards. A 
majority of principals responding (about 55%) observe that these measures 
have stimulated greater contact between parents and schools. Where program 
requirements are more stringent, i.e., where proficiency tests must be 
passed for promotion to certain grades and/or for high-school graduation, 
the proportion of principals who note increased parent contact is somewhat 
greater (slightly over 60%). 
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Principal s^Tanrof^prpflclency testing for prowotlon and gradMation . 

Some 70% of the study's high-school principals advocate that-4tudents 



promotion at certain grade levels and for high-school graduation. A 
similar proportion (72%) finds that tests of this type "are generally fair 
for all students." Principals of elementary schools tend to support both 
views, but by a smaller majority (58%). Principal s'''opirKi^on^hese 
Issues did not vary substantially according to the requirements now in 
place in their states and districts. 

Here, it is worth noting that CSE data (Choppin et al . , 1981) show 20% 
of the nation's school districts, serving roughly 35% of its pupils, 
require proficiency tests for promotion to certain grades and/or for 
high-school graduation. Another .35% of the districts, with about 32% of 
the nation's students, also work under stute minimum competency/proficiency 



mandates. Here, however, the tests are used only for diagnostic purposes, 
not as promotion or graduation prerequisites. TJje remaining districts. 



with 34% of the nation's school enrollment, operate without state-mandated 
minimum competency/proficiency testing, although a few of these have 
establisheo their own proficiency requirements. State laws \j^e been in 
flux and the figures may have changed somewhat since these d^a were 
collected. Nevertheless, the picture outlined here should helt).to j)(it 
principals' viewpoints in perspective. 

Principals find that wore required testing has led to wre basic 
skills In the curriculum . For 68% of the elementary-sc^);>^ principals and 
75% of those in high schools, the amount of testing fequi red by their 
district, by their state, on by federal programs has increased dramatically 



should be required to pass a minimum competency 




"in the last five years" (1977-1982). Simultaneously, nearly three 
quarters find that, as a direct result of testing programs, more 
instructional time is being spent in their schools on the basic-skill 
subjects of reading/English and mathematics. Principals' responses on 
these two issues, furthermore, are related at a statistically significant 
level; they tend to be consistent much more often than not. (See Table 
26.) All this suggests that if most principal's perceptions are accurate, a 
recent, marked increase in the amount of required testing has had a 
discernible impact on the curriculum: it has pushed instruction toward the 
basic-skills subjects that required tests emphasize and (probably) reduced 
the teaching-learning time available for other subjects. For the most 
part, however, principals do not find testing requirements troublesome. 
Fewer than a third say that their schools spend two much time on required 
testing and the preparations for it. (See Table 25.) .This seems in line 
with the 'majority belief that testing exerts a positive influence on the 
school s. 

Teachers: Qualified Support For Tests and Testing 

As teachers received their CSE questionnaires in the early 1980's, 
social problems such as classroom discipline, school safety, and students' 
drug and alcohol abuse captured medical attention and preoccupied many 
educators. Even compared to such problems, however, teachers in a majority 

of schools could define testing as an important concern (Table 27), just as 

I 

principals In a majority of districts do. 

More broadly, teachers' responses reflect greater concern about tests, 
testing, and their effects on schools than do principals'. Teachers do 
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Table 26 

Relationship Between Principals' Responses: 
Increase in Required Testing and More Time on Basic Skills 



Testing Has Led To More 
Instructional Time On The 
Basic Skills 



Agree 



Disagree 



Required Testing 
has 
Increased 
Dramatically 



Agree 



Di sagree 




150 55 
X2 = 37.83, p < .001 



U8 



57 



ER?C 9(; 



Table 27 

Teachers' Views on Testing and Related Issues 

'{Elementary Teachers: N « 486) 
(Secondary Teachers: N * 385) 



Percentages of Teachers 
in agreement 



Issues and Items 



El ementary 



English 



Secondary 



Math 



Testing As A Local Issue 

In our school, testing programs are generally held 
to be much less important than the social problems 
with which we are concerned 39 

0 

Quality of Tests 

Commercial tests are usually of high quality 59 

The tests developed in our dis\Tict are very good 62 

The content (or skills) on most required tests 
is very similar to the content (or skills) 
that I teach 72 

Value, Usefulness of Testing 

Testing motivates my students to s-tudy harder 73 

The pressure that testing exerts on the schools 
has a generally beneficial effect 48 

As a result of minimum competency testing (and 
similar programs) parents are contacting the 
school .. .more frequently or in greater numbers 53 
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32 

46 
62 

77 

80 
60 



42 

46 

60 

79 

93 
72 



42 36 
Continued 




Table 27 (c 

Issues and Items. 



Desirability, Fairness of Proficiency Testing 

■J 

Tests of minimum competency/proficiency should 
be required af all students for promotion at 
certain grade levels and for high school 
graduation . ^ 

Tests of minimum competency/proficiency are 
frequently unfair to particular students 

Effects on the School 



Recently, I have been spending more teaching time 
preparing iny students to take required tests 

Tests of minimum competency have affected (would 
affect) the amount of time I can spend teaching 
subjects or skills that the tests do not cover 

Basic skills teaching (Including remedial work) 
1s now consuming a substantially Increased pro- 
portion of our school's educational resources 

The proportion of our school's resources now 
allocated to basic skills teaching is so 
great as to detract from the quality of our 
overall educational program • 

Accountability For Test Results 

Teachers should not be held accountable for 
students' scores on standardized achieve- 
ment tests or tests of minimum competency 
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Percentages of Teachers 
In agreement 



El ementary Secondary 

English 



81 
58 



86 
48 



46 



41 



62 



62 



88 



84 



23 



28 



71 



61 



98 
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generally supjport testing, but from issues to fssue that support is less 
consistent, less overwhelming numerically, and (thus) more qualified than 
the support that principals express. (Refer to Table 27 here and 
throughout.) 

Most teachers agree that test quality Is htgh , although by narrower 
majorities than principals. Well over 70% of the teachers responding have 
decided that the content or skills covered by required tests, whatever 
their type, is similar to the material that they actually teach. Most iSO% 
- 62%) also agree that the tests developed in their districts are "very 
good." Opinion on the quality of commercial tests tends to divide by grade 
level. Some 59% of the elementary-school teachers find commercial tests 
(such as those that accompany reading and math series) "are usually of 
high quality," but only 46% of the high-school teachers concur. 

Teachers seek tests that they find fair and useful . It is impossible 
to know, of course, exactly what criteria the survey respondents use to 
assess test quality. Other aspects of CSE's Test Use in Schools Study, 
however, provide some clues: they suggest that teachers are most concerned 
about the fairness and practical utility of tests. 

Results of an earlier CSE questionnaire study of testing in five 
California school districts (Yeh, 1978) were reanalyzed in planning for the 
national survey under discussion here. Among the 256 elementary -school 
teachers who responded, three criteria stand out as most important in 
selecting tests. Listed in descending order of importance, they are (1) 
the similarity of test material to what is presented in class; (2) clarity 
of test format; and (3) the ease with which the test can be administered 
and/or scored. The first two criteria reflect teachers' interest in test 
fairness; the third, their desire for practical utility. 
ERIC Q ,j 



Concern with these same three features recurs throughout teachers' 

Interview comments on test quality. In addition, Interviewee's remarks 

reveal a fourth consideration, another dimension of tests' pr^actical 

utility: the degree to which tests yield information ^at teachers can in 

fact use in their routine teaching tasks. The words of one fourth-grade 

Instructor epitomize this concern: 

I don't feel we need to test, test, test; but If the 
information is something I can use to prescribe in- 
struction, I really don't mind giving it. 

These criteria provide insights into teachers' views of test quality 
and into their test-use practices. 

Teachers in both elementary and high schools tend to count the results 
of their own, self-constructed tests as especially important for routine 
instructional tasks (Tables 12 and 13» pages 49 and 50). Asking teachers 
to rate the quality of their own tests seemed unnecessary, but note that 
they do have, „from the teacher's perspective, all the qualities of good 
assessment Instruments. In making their own tests, teachers can suit 
themselves regarding the fit between what Is tested and what is taught. 
They design the format. They determine how easily the test can be 
administered and scored. They also control the timing of the test, when 
the results become available, and other factors that allow the measure to 
serve their everday, practical needs. 

In interviews, teachers at the elementary level rejiiOarly associate 
these same qualities with the commercial tests with which they work most 
frequently -- those that accompany their basal reading and mathematics 
texts. As one explained: 
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The district tells us we have to use the tests that go 
With the book -- the ones you buy from the publisher. 
But we'd all use them anyway. They match with the 
skills we're teaching and present things the same way 
[that the book does], so they're really convenient. 

This widespread view can help to explain why the majority of 
elementary-grade respondents rate commercial tests as high quality, as well; 
as why most rely heavily on the results of conmierclal, curriculum-embedded 
measures (Table 12, page 49). 

High school teachers mention these same criteria in discussing 
commercial tests, but they speak of these tests more negatively. With 
greater latitude in selecting their course content, they frequently find 
commercial tests less useful than their counterparts in the lower grades. 
An instructor of senior English spoke for many of his colleagues in saying: 

I'll occasionally use a [curriculum] kit or package as 
is, and then if there's a test that comes with it, I'll 
use it. But in most units I'm putting together 
materials, combining things from [many sources]. The 
only test that will cover it all is the one I make up 
myself. 



The remarks of a geometry teacher pinpoint another limitation of comnercial 
tests: 



We rely fairly heavily on the unit post tests we 
developed as a department. . .We don't use the book 
tests. Every one of our courses has performance 
objectives, and we have designed each unit test to 
validate to the performance objectives for the course. 
The book tests just don't do that..'. Our biggest 
concern is the validity factor, in terms of our 
objectives for the course. 



It is, perhaps, for reasons such as these that 54% of the secondary 
English and math teachers do not consider commercial tests "of high 
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quality." Such views can also help illuminate why high-school students 



spend 75% of their total testing time taking teacher-made tests {Table 4, 



The broad popularity of district-developed tests (60% ,- 62% rate them 
"very good") can also be traced to their fairness, or validity, and 
practical utility. 



That computer-processed data [on our district's 
objectives-based unit tests] can really be used with 
those kids that need help. It does a better job [than 
the other tests available] of identifying students and 
students' needs... I can work on objectives 2, 3, 5 and 



The district [testing] system is Important because it's 
the only thing you can pass on to other schools which 
is meaningful to everbody. There'-? a lot of movement 
in this town, and the elementary schools, many of them, 
use different [text] series. 



When district-made tests fail to meet these criteria, however they can be 
Ignored or deemed a burden. 



You've already tested your kids with the test that 
comes with the series. Then you have to give the 
district tests, 'cause they require you check off the 
skills on the [record-keeping] card when they complete 
them. But the district test doesn't really fit with 
the way our series lays things out, so it's a waste 
just more red tape. 

No one uses the [district-constructed] unit reading 
tests anymore. We need to, before we adopted the new 
series a couple of years ago. But now they aren't 
really valid. 



A sizeable minority of teachers does not find district-developed tests 
"very good"; problems such as these may explain their judgments. 

Finally, a word or two about teachers' views of required tests is 
appropriate here. Most survey respondents agree that these measures 
generally cover what they teach (Table 27), but many fewer count their 
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scores as of great importance (Tables 12 and 13, pages 49 and 50). 
Interviews offer an explanation for this apparent discrepancy: 
standardized and other required tests often fail to meet practical utility 
criteria. 

The [standardized test required anually in our 
district] is almost useless in the spring, which is too 
bad, because I feel there Is some valuable information 
there, progress and growth. But we get the scores the 
last week of school . 

A high school teacher added: 

You don't get individual students' scores on the 
[state-assessment test], and the standardized results, 
they're there in the [cumulative-record] folders. But 
I have 150 students. I don't have time to go down to 
the office and look through all those folders. 

More generally, nearly every teacher interviewed echoed views of an 

elementary-school teacher in urban New England: 

I think that the children feel good about [a test] and 
I feel good about it if I can see where it is actually 
helping the child and you can put it in context. But 
when you pull it out of the context, out of the 
classroom teaching situation and the actual curriculum, 
and give a child a test just to rate him nationwide or 
whatever, that bugs me. It really bothers me. 

This statement summarizes teachers' interest in tests that cover what they 

believe they are teaching and also provide information that teachers can 

use in their routine teaching tasks. 

Teachers value testing as a wotlvator . Nearly three quarters of the 

elementary teachers and even larger proportions of the secondary 

instructors (Table 27) claim that testing motivates their students to study 

harder. This can be a primary reason for some classroom assessment. As 

one high-school English teacher explained in her interview: 

I'd like to eliminate the quizzes thai I give every 
i week or so, but I have to do it to motivate the 
students to do the reading. 
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Most high-school teachers (60% 1n English; 72% In mathematics) also 

concur that the pressure that testln^g exerts on the schools has a generally 

beneficial effect. "It's kind of nice to get results back," said one who 

was Interviewed. "It does give you more of a feeling of accountability and 

It's not overwhelming." Another added: 

I think that within this city there has been a lack of 
standardized testing, which I think has allowed things 
to go downhill. That 1s, if you don't measure versus 
some outside standard you don't know how good or bad 
things are going in the system, and it can just tend to 
get worse. 

At the elementary level, however, fewer teachers (48%) agree that the 

pressure generated by testing is beneficial. One sixth-grade Instructor 

voiced a concern felt by many others who were Interviewed: 

There's too big a trend to judge teachers and schools 
by tests. They publish test results in the papers, and 
people use them to judge teachers and rank schools. 
This is the danger, [of testing], using the results In 
the wrong way. 

Indeed, most teachers who responded to the survey (but somewhat fewer at 
the secondary level) assert that teachers should not be held accountable 
for students' scores on standardized or minimum comptency tests. (See 
Table 27, "Accountability for Test Results.") It appears, then, that many 
teachers (along with their principals) believe that schools, but not 
individual faculty members, bear responsibility for how learners perform on 
achievement tests. 

About the same proportion of elementary-grade teachers (53%) as 
principals (56%) observe that parent-schoci contacts have increased as a 
result of minimum competency testing and similar programs. Only a minority 
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of high-school teachers agree: 42% in English and 36% In math; as compared 

to 54% of their principals. It may be that parents speak more frequently 

with central office personnel than with teachers about their high-school 

students scores. It may also be, as many teachers argue, that parents' 

active Involvement with their children's schools diminishes as their 

younsters proceed through the grades. Whichever the case, some teachers of 

secondary school fault parents for their lack of concern. An English 

Department chairperson captured the feelings of many when he reported with 

frustration that: 

The point was, the legislature wanted to test [for 
minimum competency] and to assure effective 
communication, with the possibility of remediation, 
before the kid goes out [of high school]... We had a 
form letter we sent out to about 150 parents where the 
students failed and couldn't graduate unless they got 
it together and passed. It said something like, "Your 
child has failed the following competencies" -- there 
was a place to check which ones — "and we'd like you 
to come in and discuss this." Well, out of 150 parents 
only six. I think it was, actually showed up. 

In summary, then, most teachers believe that testing exerts useful 
pressure on students, but their opinions are more divided about testings' 
effects on educators and parents. 

Teachers heavily favor proficiency tests as prowotlon and graduation 
requlrewents. but wany doubt that such tests are unlfomly fair . Fr om 80% 
and 90% of the survey respondents (Table ) believe that all students 
should be required to pass proficiency tests in order to win promotion to 
certain grades and to graduate from high school. Interviewees' arguments 
in support of this position were usually quite general. "It's good for the 
student to know that he has to pass a certain level of competency," said 
one. Another simply asserted, "Students who are Incompetent should be 
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failed." At the same time, a majority of elementary-school teachers (58%) 
and substantial proportions of high-school Instructors (48% In English; 35% 
in mathematics) judge that minimum competency (proficiency) tests "are 
frequently unfair to particular students." 

Holding both these views simultaneously, as many teachers obviously 
do, does not necessarily signal Inconsistency or an indifference to 
fairness. One can support the general concept of minimum competency 
requirements while doubting the uniform fairness of the particular tests 
now In use. In fact, there is evidence that as teachers actually 
experience minimum competency testing for promotion or graduation, they 



become more concerned Itbut the fairness of the tests, more cautious about 
using them as gatekeeping standards, or both. This is exactly what Table 
28, below, demonstrates. (Compare teachers' combined, mean responses on 
the fairness and should-be-required-for-promotion/graduation statements. 
Those of teachers in states where such requirements are now in effect are 
significantly lower -- significantly less "pro-competency testing" than 
those of teachers elsewhere.) 

Fieldwork interviews reveal some of the kinds of experiences that can 
lead teachers toward more circumspect views of the fairness and 
desirability of testing for promotion and graduation. 



I wanted to tell you about the competency tests [said 
one high-school English teacher in a state that 
requires them for promotion and graduation]. Tm not 
happy with them, although I was on the committee that 
developed them for our district. There are eight 
competencies the [high school] kids have to pass... in 
one, they have to read a bus, train or plane schedule 
and answer eight questions about it. When we gave the 
bus schedule, we found that the black kids, the 
Hispanic kids -- they ride the bus more and they did 
distinctly better on that than your more suburban kids. 
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-3 Table 28 

Teachers' Views on the Fairness and Desirability 
of Minimum Competency Testing (MCT), 
By Current State Requirements* 



State Requirement 


SECONDARY-'' 


ELEMENTARY' 


MCT required for promotion/ graduation, 
state-mandated measure 


3.56 


4.24 


MCT required for promotion/graduation, 
local choice of measure 


3.76 


4.29 


MCT required for diagnosis, 
state-mandated measure 


3.93 


4.38 


MCT required for diagnosis, 
local choice of measure 


4.20 


4.96 


No MCT required 


4.16 


4.79 



* Ex pTanation . The values on this scale range from 2 (a strongly negative view of 
MCT} to 8 (a strongly positive view of MCT). 



The scale shows the mean (or average) combined responses of teachers in each 
category to two survey statements: 

(a) "Tests of minimum competency/proficiency are frequently unfair to particular 
students"; (1 - strongly agree, 2 = agree, 3 « disagree, 4 « strongly 
disagree) ; 

(b) "Tests of minimum competency/proficiency should be required of all 
students. . .for promotion. . .and for high school graduation"; (1 « strongly 
disagree, 2 = disagree, 3 « agree, 4 = strongly agree). 



1. Differences between groups statistically significant at p < .05 

2. Differences between groups significant at p < .01 
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the white k1ds. Kids here at this school and others 
from, well, where they're more likely to take the bus, 
they had better results. There's clearly cultural bias 
here... Another competency is filling out a job 
application, a standard form. [He shows one]. See, 
now if the student goes over the the line here as he 
fills this in, that's counted as an error. So some of 
this is very trivial, unfair really... There are other 
problems, too, and it's difficult figuring out how to 
resolve them. You begin to question whether you can 
ever come up with a test that's really fair. 

Another teacher of high-school English cited inequities in how his district 

handles minimum competency requirements: 

The value of the district comptency tests is that they 
are very explicit. Nobody has any questions about 
what's being tested... And I believe in failing a 
student for being incompetent. But you have to place 
responsibility on the students to work their way 
through [the tested skills] step by step. Here, a 
sophomore can pass part of the English [competency] 
requirement, fail others, and be passed right through 
all of his other classes and not be able to write a 
decent letter, not be able to demonstrate eighth-grade 
skills. So now, as a senior, they have special 
tutoring on how to pass the test and they graduate as a 
competent senior. That's not fair to anyone, either 
the kid who goes that route or the one who really 
masters the skills. 

Thus, while there is among teachers a general enthusiam for minimum 

competency tests as requirements for promotion and graduation, there is 

also notable concern about the fairness of these tests. This concern is 

significantly greater, and questions about the requirements themselves loom 

larger, where teachers have had to operate under testing-for-promotion/ 

graduation mandates. 

Most teachers find an Increased currlcular eiphasls on basic skills, 

due at least In part to testing, to be acceptable . As reported earlier, 

the vast majority of principals have noted a dramatic increase In required 

testing through recent years. Such testing usually in the form of 
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standardized batteries, other minimum competency measures, and state 
assessment Instruments -- typically places heavier emphasis on basic 
reading, English, and mathematics skills than It places on other areas of 
the curriculum. Citing this fact, critics frequently argue that burgeoning 
testing requirements are "contracting" public school's curricula: forcing 
them toward a focus on basic skills at the expense of other subjects. 
Principals concede that testing programs have caused more instructional 
time to be spent on basic skills Instruction, but there is nothing to 
suggest that they find this troubling. (Table 26, page 88). 

On the whole, teachers appear to support their principals and to 
reject the critics' argument. Along with the school administrators who 
responded, the teachers surveyed report a marked increase in basic skills 
Instruction. Some 88% at the elementary levels, 84% in high-school 
English, and 74% In high-school mathematics agree that "basic skills 
teaching. . .1 s now consuming a substantially increased proportion of our 
school's educational resources." Only about 25%, however, feel that this 
detracts "from the quality of our overall educat'onal program." (See Table 
27.) Furthermore, fewer than half the teachers surveyed say that they have 
spent more time recently preparing their students for required tests. (At 
the elementary level,, 46%, in secondary English and mathematics, 41% and 
30%, respectively). 

The "testing contracts the curriculum" argument does draw some support 
in survey responses, however. Teachers who find they are devoting more 
teaching time to preparing learners for required tests constitute a size- 
able minorfty, as the figures just cited indicate. Representing their 
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views, one teacher of grades 3 and 4 said, 

I'd like to cut ell the testing down to about 
half. If, seems like everything is testing; 
everything is evaluating. It is so con^nu- 
irrg,^ It's almost suffocating. We have no 
time for any music or art. My kids used to 
learn English through writing stories and 
newspapers. We have no time for any of 
" that. This is just cut-and-dry teaching, 
drill on tested skills. 

In addition, a great many teachers believe, that minimum competency 

mandates have affected (or would affect, if instituted) the amount of time 

that they can spend teaching skills and subjects not covered by these tests 

(62% in the elementary grades; 62% in high school English; 42% in high 

school math.) Some of the teachers interviewed during fieldwork explained 

how this can happen. Discussing a math competency measure her students had 

to take, a fifth-grade teacher remarked. 

Ahead of time, because the format of the test 
is so different [from the tests my students 
usually take], we had to have the kids do 
worksheets and so on of that type so that 
when they did take the test, they were 
familiar with how to go about it, the mechan- 
ics of the test. Now, that's all time out of 
the classroom, and I couldn't use the scores 
for a thing. 

A high-school instructor in d course called Consumer Math ^added: 

Well, see they use this course for kids who 
have failed the [proficiency] tests. So what 
I do, I spend the first four weeks doing 
nothing but reviewing the skills and having 
them take old versions of the test, the first 
month of school, really. Then you see which 
kids are going to have trouble on which of 
the four 'tests, then that's what you teach 
them. 

Still another explanation of minimum competency testing's influence on the 
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curriculum was offered by an algeb*'a teacher; 

The first time they gave [the state 
proficiency test, required for diagnostic 
purposes only], I found there were kids 
having problems with certain things, and we 
really didn't emphasize those too much. So I 
went back and taught thos^ things, which 
meant I dropped other units we'd usually 
cover. 

All in all, however, most teachers appear comfortable with the 
increased emphasis on basic skills that they find. And while most believe 
that minimum competency requirements affect what they teach, only a 
minority conclude that they must spend more time preparing students for 
required testing. 

Where distrtctiride socioeconoaric status (SES) Is lower, teachers find 
more eaphasis on tested and basic skills . Individual teachers' responses 
on the four survey statements just discussed— those listed under "Effects 
on the School" in Table —tend to correlate highly with one another. It is 
reasonable, then, to sum their responses on these items to obtain an 
aggregate indicator of the perceived emphasis on tested and basic skills. 
CSE survey analysts did so in an effort to determine whether this emphasis 
varies with environmental factors. 

Districtwide socioeconomic status (or SES) is one feature of the 
school environment that is clearly re'lated to a curricular emphasis on 
tested and basic skills. (See Table 29.) Teachers workid3g in low SES 
communities find more need to stress tested skills in their classrooms and 
more stress on basic skills in their schools than those working in higher 
SES districts. At the elementary level, this response trend Is statistic- 
ally significant. It appears, then, that testing is xlriving the curriculum 
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Table 29 



Teachers' Perceptions of the Emphasis 

/ on Tested and Basic Skills, 
By District Socioeconomic Status (SES)* 



District SES Ranking! 


ELEMENTARY2 


SEC0NDARY3 


High 


10.41 


9.52 


Middle 


10.35 


10.13 


Low 


11.46 


10.36 



* Explanation . The values on this scale range from 4 (perceive no increased 
emphasis on tested and basic skills) to 16 (perceive greatly increased 
emphasis on tested and basic skills). 

The scale shows the mean (or average) combined responses of teachers in category to 
the Four statements listed in Table 27 under the heading, "Effects On the School" 
(pages 89 and 90). On each of the four statements, 1 « strongly disagree, 
2 = disagree, 3 = agree, 4 » strongly agree. 



1. The Orshansky Index was used as an indicator of school district socioeconomic 
status. 

2. Differences among groups are statistically significant at p < .01 

3. Differences among groups are not statistically significant. 
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In economically disadvantaged areas to a greater extent than elsewhere, 
particularly In elementary schools. 

If this Is In fact occuring, what accounts for It? Is 1t simply the 
belief that students from low SES backgrounds need more learning time than 
others on the basic skills that tests cover? Perhaps, but others forces 
seem to be at work here, too. Principals In lower SES schools report pay- 
ing more attention to test scores than those In higher SES schools.. They 
count the results of standardized batteries, state assessment measures, and 
district-objectives-based tests as more Important for Informing district 
officials, the public, and parents ab^ut school achievement {Table 11 page 
47.) In addition, districts more often establish specific test-score goals 
for lower SES schools. (Princlp Is In 40% of these school report that 
their districts do so, while only 10% of the principals in higher SES 
schools do.) At the same time, however, national studies repeatedly show 
that students from lower SES background do less well on tests than peers 
who are more well-off. Thus, in lower SES schools, where more students 
have difficulty on achievement tests, achievement-test scores seem to count 
for more, to be more consequential. This can help to explain why, if the 
teachers responding are correct, educators In lower SES schools sp^ , more 
time and resources than others on teaching the material that tests cover. 

In states trhere wlnliiua cowpetency (proficiency) testing Is required 
for prowotlon and/or graduation, high-school teachers note a significantly 
greater ei^hasls on tested and basic skills . To a greater extent than 
secondary teachers elsewhere, they find that more school resources are 
devoted to basic-skills subjects, that they must spend more teaching time 
preparing students for tests, and/or that they must focus instruction on 
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Table 30 

Teachers' perceptions of the Emphasis on 
Tested and Basic Skills, By State 
Minimum Competency Testing (MCT) Requirements* 



STATE REQUIREMENT 


elementary! 


SEC0NDARY2 


MCT required for promotion/graduation, 
state-mandated measure 


10.81 


r « 11.06 


MCT required for promotion/graduation, 
local choice of measure 


in. 17 


10. 13^ 


MCT required for diagnosis, 
state-mandated measure 


10.58 


9.91 


MCT required for diagnosis, 
local choice of measure . 


10.11 


9.40 


No MCT required 


10.79 


9.99 



* Explantion . The values on this scale range from 4 (perceive no increased 
emphasis on tested and basic skills) to 16 (perceive greatly increased "emphasis 
on tested and basic skills. 



This scale is the same as that in Table 
explanation. 



See footnote to Table for further 



1 Differences among groups are not statistically significant 

2 Differences among groups are statistically significant at p < .01. 
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the skills that minimum competency tests cover. (See Table 30.) For some 
illustration of these phenomena, review the last set of interview comments, 
quoted on pages 102 and 103 .) 

This same response pattern is not evident among elementary teachers. 
Those in states requiring minimum competency tests for promotion and/or 
graduation do not percieve a greater tested-and-basic skills thrust In 
their curricula than teachers operating under other conditions. This may 
be because the potential consequences of strong minimum competency 
requirements are deemed less serious for students in the lower grades (no 
promotion) than for those in high school (no graduation). 

Together with the findings regarding SES discussed in the previous 
section, those described here support the hypothesis that where test 
results have greater consequences, testing Influences the curriculum more. 
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CHAPTER 6 

THE SCHOOL CONTEXT AND CLASSROOM TESTING PRACTICES 
A central goal of CSE's Test Use in Schools Study was to provide a 
national portrait of assessment practices and attitudes toward student 
achievement testing in schools across the nation. The four previous 
chapters have done that, with illustrations and elaboration from fieldwork 
in a number of schools and school districts. A second goal of the study 
was to address the question, "What factors seem to influence the assessment 
practices that currently exist iji our nation's schools?" A framework for 
examining this question was introduced in Chapter 1. 

One way in which the study tested that framework was by examining 
relationships between testing practices and viewpoints and environmental 
features external to the school, e.g., state and local testing 
requirements, federal and state programs, the nature of the school 
community and its students. The results of those analyses which produced 
statistically significant results have alreacly been reported. In review: 

* Secondary students in states without minimum 
competency or proficiency testing time spend a 
significantly greater amount of time each year taking 
classroom achievement t^,ts than students in other 
states. Secondary sttf^ents where minimum competency 
testing is required for promotions and/or graduation 
spend the least amount of time on classroom 
achievement testing. 

* Teachers perceive a significantly greater emphasis on 
tested and basic skills in: (a) elementary schools 
in lower socioeconomic areas, and (b) high schools in 
states that require minimum competency (proficiency) 
testing for promotion at certain grade levels and/or 

« for high-school graduation. 

A second way in which the study sought to discover Influences on 
testing practices and beliefs was by exploring relationships between and 



among test use patterns, attitudes toward testing and various school 
contextual factors. Thv* latter included leadership practices in monitoring 
and supporting testing, teacher training and staff development, the 
presence of resources that support Classroom testing, the organization of 
curriculum and instruction, and the presence of resources that facilitate 
instructional differentiation in the classroom. It begins with an 
explanation of the variables used in the analyses and then goes on to 
describe the relationships uncovered, highlighting those factors which were 
found to be significantly related to testing pracitces. 

This chapter reports the results of this exploration. The chapter 
concludes with a conceptual model that integrates all the relational 
analyses conducted, a model that helps to explain patterns of test use in 

the nation's elementary and high schools. 
Tfie Variables In the Analyses 

The analyses investigating relationships between and among test use, 

attitudes toward (or beliefs and perceptions about) testing, and school 
contextual factors employed variables developed by aggregating related 
questionnaire items. These variables and their derivations are described 
below. 

Test use variables - Information on teachers' use of tests was derived 
from the survey questions described in Chapter 3. Use of four types of 
tests or assessment strategies were examined: 

(1) Use of Formal Testing , including: standardized, 
norm-referenced tests; district objectives-based 
tests; and minimum comptency tests; 

(2) Use of Curriculum-Embedded Tests , including:"' 
placement, chapter, and unit and other tests "that 
come with the curriculum materials I use"; 

(3) Use of Teacher-Made Tests ; 
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(4) Use of Teacher Observations and Professional 
Judgment , including; "ny own observations and 
students' <lasswork," previous teachers' comment 
and grades, and previous teaching experience. 

«i Teachers who responded to the survey rated the Importance of each of 
these types of assessment «for four different classroom tasks: planning. 
Initial grouping or placement, regrouping or changing placement, and report 
card grading. (See Chapter 4 for details.) Thus, to determine teachers' 
overall use of each of the four assessment types listed above, their 
ratings of the Importance of that type were summed across all four tasks. 
If, for example, they rated teacher-jnade tests as "critical" (value « 4) 
for all four tasks, they received a "score" of 16 for use of teacher-made 
tests. Or again, If they rated curriculum-embedded tests as unimportant 
(«1) for planning, somewhat Important («2) for Initial grouping of 
students, and Important (»3) for re-grouping and grading, they received a 
score of 9, adding the four ratings, for use of curr1fuj,um-embedded tests. 
In the assoclatlonal analyses, these scores were averaged across groups of 
teachers. 0 

Belief and perceptions variables . Information on teachers' 
perceptions and beliefs (or attitudes) about testing were derived from ^ 
survey questions described In Chapter 5. Based on confirmatory factor 
analyses, these questions were aggregated to create three "attitude" 
variables: 

(1) General Attitude Toward the Quality of Tests ; This 
variable was constructed by summing teacher ^ 
responses to the statements listed In Table 27 
under the headings, "Quality of Tests" and "Value, 
Usefulness of Testing." This provided an overall 
Index of the extent to wh1(;h teachers felt testing 
was, on the whole, a good thing or a bad thing. 

(2) Perceived Emphasis on Tested and Basic Skills , 
mis variable was constructed by summing teachers ' 
responses to the statements listed In Table 27 
under the heading, "Effects on the School." 
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(3) Attitude Toward Minimum Competency Testing . This 
variable was constructed by summing teachers' 
responses to the two statements listed In Table 27 
under the heading "Fairness, Desirability of 
Minimum Competency Testing." 

The procedures for summing responses In building these scales followed 
those described above In the discussion of the test use scales. 

School leadership In linking test results with Instruction . This 
variable was built by summing teachers' responses (not principals') to the 
three statements listed under "The School Administration..." In Table 20, 
Chapter 4. It represents the regularity with which school administrators 
meet with teachers to examine the currlcular and Instructional Implications 
of test scores, check to see that teachers follow up on these Implications 
In their teaching, consider students' test results In teacher evaluation, 
and/or establish specific test-score goals for teachers to meet. Below, 
all this Is glossed by the label, "Currlcular Accountability," since It 
reflects the extent to which schools make currlcular decisions based on 
test results and hold teachers accountable for these decisions. 

Information and training about testing . Data on this factor came from 
teachers' responses to the Items displayed In Table 23, Chapter 4, which 
asked respondents to Indicate the kinds of Informational and Instructional 
activities their districts and schools had provided In the area of 
assessment over the past two years. Exploratory analyses sought to 
Identify patterns In teachers' answers that would Indicate types of staff 
development emphases, e.g., training programs that focused on Improving 
teachers' skills at classroom assessment. In Interpreting the Instructional 
Implications of test scores, on preparing students for testing, etc. These 
analyses showed no such patterns, however. In the end, this variable was 
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constructed simply by totaling the number of different Informational or 
Inservlce actlvltes In which teachers said they h«d participated. Thus, It 
may represent the amount of attention paid to assessment Issues In a 
teacher's school as much as It represents the depth of Instruction teachers 
have received In testing. 

Resources that facilitate cTassroow testing . Data on these resources 
was gathered through the questionnaire Items listed in Table 24 of Chapter 
4. The variable reflects how many of the four resources shown there (test 
item banks, computerized scoring, assistance In correcting and grading 
tests, coUegial help in constructing tests) teachers have available and 
how frequently they use those that they have. 

Resources that facilitate Instructional differentiation In the 
classroow . In a set of questionnaire Items not previously discussed in 
this paper, teachers were asked to indicate which of the following five 
human and mater<al resources were available to them: (1) an aide, 
paraprofessional , or volunteer to assist with small group Instruction or 
individual work; (2) other teachers with whom to divide up students "for 
extra help"; (3) instructional machines (audiovisual, computer, etc.) for 
Independent work; (4) alternative curriculum materials for Independent work 
to meet special needs (e.g., self-paced kits, etc.); and (5) specialists 
outside the classroom to whom students can be sent for special work. In 
addition to noting which of these were available to them, teachers 
estimated how frequently they used those that were. Thus, this aggregate 
variable was built by summing the number of the five resources a teacher 
used Infrequently (several times a year or less, scores as "1") and the 
number used frequently (monthly or more often, scored as "2"). 
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Studencs' total testing taking time . In terms of the total number of 
minutes spent annually as reported by teachers, was also considered In the 
context of these variables. Student's time on testing, however, was 
related to none of them; it is discussed no further here. 

Some Relationships Between Testing Practices, Attitudes Toward Testing, and 
School Contextual Factors . 

Correlations were run in a first analysis step to explore relation- 
ships between the variables just described. Table 31 shows the statistic- 
ally significant results. As noted above, the information-and-training- 
about- tests factor reflects how much Information and training teachers 
received through staff development activities in the last two years. It 
seemed reasonable to assume that knowledge about testing and about how test 
results can be used in the classroom could facilitate teachers' use of 
tests and/or Influence their attitudes toward testing. The correlative 
analyses support these hypotheses, particularly at the elementary-school 
level. More training is associated with greater use of formal tests for 
instructional decision-making and with more positive attitudes towards the 
quality and utility of formal tests. (See Table 31.) Amount and diversity 
of staff development, however, are not related to the use of 
curriculum-embedded or teacher-made tests-- probably because the kinds of 
inservice training teachers report usually focus on more formal measures, 
(Chapter 4, Table 23). 
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Relationships Between Contextual Factors and Testing Practices 



LEADERSHIP SUPPORT 



INSTRXTIONAL RESOURCES 

El em. Sec. 
R M E M 



TESTING RESOURCES 
E1em. Sec. 



STAFF DEVELOPMENT 

Elem. Sec. Elem. Sec. 

R M E M R M E M R M E M R ^M E M 

Attitude Toward Quallly of Tests .318 .206 .215 * .230 .206 _ 

Use of Formal Testing .350 .300 .198 .256 .219 .235 .163 .333 .171 .288 .207 .230 .229 .340 .126 .220 

Use of Continuum Enfcedded Tests .156 .376 .254 .391 .215 .236 .232 .361 .286 .237 

Use of Teacher Made Tests , .206 .430 _ .241 .362 .176 



* Statistic y non-significant (p. 2.05) correlations have been Indicated with a * _ ' 
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Curricular accountability Is also related to test use a^d attitudes 

s 

toward formal tests. Survey results Indicate that when principals show / 
that they care about test scores — by reviewing them to Identify 
curricular weaknesses, taking action to assure teachers are emphasizing 
skills that test scores show are needed, etc. — teachers rate tests as'^ 
more Important In their Instructional planning and, simultaneously, feel 
that -tests are more valuable and useful. ' 

Survey findings indicate that resources to facilitate classroom 
testing are not widely available (Table 24, page 76). Nevertheless, the 
greater the number that are available, the greater the Importance teachers 
accord to all kinds of assessment results, Including their own 
observation-based judgments. 

The use of test results for Instructional pi arming and decision-making 
assumes that some action can be taken on the basis of student test scores 
— e.g., providing .ediatlon or advanced work for Individual or small 
groups of students. Ins,t;ruct1onal resources, such as aides. Instructional 
machines, and alternative curriculum materials must be available to make 
such actions feasible; where there are no options, no decisions are 
necessary and likewise test scores Indicating the need for alternative 
actions are superfluous. Survey findings support this logic: availability 
of Instructional resources Is related to the use of all kinds of tests at 
the elementary school level and to the use of formal and curriculum 
embedded tests at the secondary level. 

A Conceptual Model for Teacher Test Use ^ 

The previous section presented the results of a series of exploratory 
analyses designed to identify possible relationships between school 
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contextual factors, attitudes toward testing and test use. This section 
examines these relationships within the framework of a single conceptual 
model that would examine all the Influence on testing embodied In the 
stu(!ty, I.e., both those In the Immediate school context and factors 
external to the school, capturing important policy implications of the 
study. It should be stressed that while this examination was conducted 
using the techniques of path analysis, the results should not be construed 
as anything more than suggestive. Because of the exploratory nature of the 
analyses no formal tests of the conceptual model or of alternative models 
were conducted. Only single relationships (paths) were tested for 
statistical significance. Thus, while the model presented shows 
significant relationships between the constructs, it shows only one set of 
relationships, not necessarily the most powerful statistically. The 
remainder of this section is organized by the results of the path analysts 
for elementary and secondary teachers. 
Elementary Teacher Test Use 

The conceptual model shown in Figures 3 and 4 incorporates the results 
for four different "outcomes": teachers' use of formal tests, curriculum 
embedded tests, teacher-made tests, and teacher observations/ judgments. 
For each of these, we examined the relationships between amount of use and 
the above variables including: attitudes about quality of tests, perceived 
emphasis on tested basic skills, school leadership in linking tests results 
with instruction, information about tests, testing resources and 
instructional resources and school level socioeconomic status. It was 
hypothesized the school SES would act as an exogenous variable in this 
system of relationships. Further, it was thought that school leadership in 
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CONCEPTUAL MODEL FOR ELEMENTARY SCHOOL TEACHERS'TEST USE IN READING* 
♦Reported values correspond to standardized path coefficients that were statistically significant (p<.05) 
♦♦Reported coefficient statistically significant (p< .06). 
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linking test results with Instruction would Influence the amount of 
Information and training received by the teachers. That Is, participants 
who were viewed as emphasizing and supporting greater use of tests were 
also likely to provide and require more training on test use. Lastly, it 
was assumed that leadership and information would relate to attitudes about 
test quality and basic skills press. 

The tejiabmty of these hypotheses can be ascertained from the 
results presented In Figures 3 and 4, displaying results of elementary 
school reading and mathematics. The paths drawn in these figures represent 
statistically significant regressions between the variables involved. 
Paths not drawn in the diagram indicate that the regression was not 
statistically significant.* Looking at the results in these two figures, 
one is struck by the high degree of correspondence. In fact, there is only 
one relationship that was statistically significant in one case and not the 
other. For elementary teachers there is a significant relationship between 
the amount of instructional resources and use of formal tests in 
math while that relationship does not appear for reading. With that 
exception the two models are Identical in their structure indicating that 
the same mechanism is likely to be operating regardless of subject matter. 

Beyond the concordance between the two cases there are several 
interesting features of the model. First of all, the influence of SES on 
the use of tests in decision-making is moderated through variables which 
are directly under administrative control. Specifically, the 

* A probability level of .05 was used in these analyses to determine 
statistical significance. The single 'exception to this criteria has 
been noted in the Figures. The basis tor this exception was the 
exploratory nature of the analysis which generally Involves somewhat 
more lenient criterial for examination of results. 



130 



" 120 - 

amount of information and training about tests and the degree to which the 
principal exercises leadership and holds teachers accountable, moderate the 
influence of SES on test use. Thus, regardless of a school's SES it 
appears possible through admi hi strati ve steps to influence a teacher's use 
of tests. This administrative effect appears to be manifested through the 
attitudes that teachers have about tests. In particular, teachers seem to 
have better attitudes about the quality of tests in schools where there is 
more information and training about tests. Additionally, teachers who are 
more informed about tests and are held more accountable by the principal 
for test results also perceive a greater emphasis on basic skills and basic 
skills tests. These characteristics translate into greater use of formal 
testing in making classroom decisions. 

The use of formal tests is also a function of the amount of resources 
available to the teacher. The greater amount of testing resources (e.g., 
scanning, scoring help) the greater the use of formal testing. Further, 
Increased instructional resources leads to greater use of formal testing. 
The hypothesis here is that resources permit instructional alternatives or 

/" 

options. The existence of these options requires greater decision-making 
on the part of teachers and hence greater use of test results. 

The use of curriculum en^edded tests seems to be a function of the 
amount of both testing and instructional resources as well as the teacher's 
perception of the quality of tests. In situations where the teacher feels 
that the commercial tests are well made, they will be more likely be 
employed in decision-making. Again, the role of resources seems to be one 
of making testing or test use more feasible. 
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5 

It Is Interesting to see In the results of these analyses that the 
only contributing factors to the use of teacher-made tests and teacher 
judgment are the resources available to the teacher. This finding may 
reflect the pervasive use by teachers of these mechanisms for arriving at 
instructional decisions almost independent of other sources of 
information. That is, there may be a feeling on the part of teachers that 
their own tests and judgments are more suitable for decisions than more 
formal measures regardless of their attitudes and training about these 
latter tests. 

In sum, the model portrayed in Figures 3 and 4 shows that the use of 
test information in teacher decision-making can be influenced by 
administrative action. In particular, the administrator can require 
greater accountability on the part of the teachers, provide more 
information and training about tests and. If feasible, supply additional 
testing and/or instructional resources. Each of these actions appears to 
positively influence the use of one or more types of test use. 
Secondary Teacher Test Use 

Similar analyses were performed for secondary school teachers who 
"taught fn^gTi-stT -and-mathematit:r.-- The results of these- analyses are 
presented in Figures 5 and 6. As can be seen from these figures the 
picture at the secondary level is not nearly as clear nor consistent. In 
fact, there are few statistically significant relationships for the English 
teachers and those that do exist are for the use of curriculum tests. 
Because of the paucity of relationships for these teachers it would be 
hazardous to attempt to interpret them or the model. 
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FIGURE 5 

CONCEPTUAL MODEL FOR SECONDARY SCHOOL ENGLISH TEACHERS' TEST USE* 
♦Reported values correspond to standardized path coefficients that were statistically significant (p<.05) 
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The results for mathematics teachers are somewhat more encouraging 
though stm not as conceptually appealing as the elementary school 
results. The results In Figure 5 show that a somewhat similar mechanism to 
that found In elementary schools may be operating for the use of formal and 
c^urrlculum tests. That is. It appears thj^t administrative leadership, 
Information about tests, and testing resources are all influencing the use 
of formal, and currlcular tests. What appears to be different at this 
. level, however. Is the greater direct role of school leadership In linking 
.test results with Instruction. This variable has strong direct relation- 
ships to both' use variables. Further, this variable, rather than Informa- 
tion about tests, seems to, relate to teachers' attitudes about test 
quality.' Thus, these results seem to point to a greater direct role for 
the principal at secondary school than at the lower grade levels. It 
should be noted, however, that th^ same constellation of factors are 
evolved. It is just t"heir relative priorities and interrelationships that 
are different. Therefore, from a prescriptive point of view, working on 
the three variables of Information and training about tests, school leader- 
ship, and testing resources seem most likely to pay off In terms of greater 
teacher use of formal and commercial tests. 

' In summary, these analyses have explored a possible prescriptive model 
for teachers' use of different types of Information In their decision- 
making. While the results showed some disparity between elementary and 
secondary teachers,. parti cul arly for secondary English teachers, some 
definite simnarities were found. In particular, it appears that three 
policy relevant afd administratively manipulatable variables are related to 
increased use of formal and commercial tests. These three variables are 
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the amount of currlcular accountability operating In the school, the amount 
of Information and training given to the teachers about tests, and the 
amount of testing- related resources made available to the teacher. It 
would appear that If Increased use of formal test results were considered 
desirable goal. Increased emphasis should be placed In the three areas- « 
mentioned above. 
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CHAPTER 7 
SUMMARY AND IMPLICATIONS: 
ISSUES FOR STAFE AND NATIONAL POLICY MAKERS 

The findings of.CSE's Test Use In Schools Stu<|y map the topography of 
baslc-sklUs achievement testing and achievement test use In public schools 
across the United States. They show patterns of local assessment practice, 
demarcate the domain and scale of local leadership In assessment, and shade 
in the tones of local educators' beliefs about testing and Its Influences 
on their schools. Through Its aissoclatlonal analyses, the study also draws 
some tentative lines between regions on this map. That Is, It models some 
ways In which these w1 thin-school phenomena appear to be tied functionally 
to one another and to certain conditions beyond the schools. 

This map was constructed, as Chapter^ 1 explained, with certain policy 
concerns In mind. Thus, It not only describes the landscape of public 
school achievement testing; It also illuminates It such that: (1) some 
Issues and concerns particularly important to national and (especially) 
state policy makers stand out in relief; and (2) some answers to local 
policy makers', questions become clearer. 

After an Interpretive review of study findings that frames the 
discussion of both these sets of policy Issues, this chapter outlines three 
that fall In the first category listed above those most appropriately 
Addressed at the state and national levels. One Is the matter of equity in 
testing, as raised by study findings regarding the Impact of required 
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tests. The second Is the Issue of teacher preparation and local test 
quality, as raised by findings of this and related studies. The third Is 
the critical need to explore ways of integrating, aligning, or 
rationalizing assessment such that the same or similar test data can be 
aggregated to address the diverse needs and multiple questions of policy 
makers at various hierarchical levels in the nation's educational system, 
e.g., in the classroom, the school, the district, the state, and the 
federal government. 

In the next chapter, case study data elaborate survey results and 
suggest concrete answers to questions of test utilizations and testing 
efficiency at the local level. More specifically, that chapter 
demonstrates some ways in which district administrators can act to achieve 
collective links between testing and instructional decision making. 
Siflwary; The Stu<|y Reveals Two Tiers Of Achteveaent Testing, Both 
Under«Utni2ed . 

A close examination of Test Use in Schools Study results confirms that 
there are two tiers or layers of student-achievement assessment in our 
schools today. These are consistently distinguishable from one another in 
their proprietorship, characteristics, and functions. One tier of 
assessment is Internal or local to the schools. It is "owned," and for the 
most part produced, by teachers themselves. This local or Internal tier 
Includes two main types of assessment: (1) the tests, quizzes, and other 
measures that teachers construct and administer in the course of their 
teaching, and (2) the clinical judgments of students' achievement that 



140 



- 128 - 

"teachers form as they Interact with students and observe their work In 
various classroom situations day after day. A third kind of measure also 
figures in this tier, but It Is especially important for elementary-school 
teachers. These are the tests Included with commercial curriculum 
materials used In the classroom. While these are not produced In the 
school, teachers In the elementary grades are most often Invested In them. 
Teachers often have a say In choosing (and choosing how much to use) them 
and the materials they accompany; teachers can time their administration 
and adapt their content to fit the pace and emphases of Instruction. 

The second tier of assessment Is external to the school: mandated by 
the district, state, and/or suggested by federal program requirements 
(fc.g., for placement In compensa'iory education programs). Norm-referenced, 
standardized test batteries are the most common among these. Other types 
of measures used for minimum competency (or functlona'f literacy) testing or 
as part of state assessment programs are also Included here. In some 
cases, too, tests constructed o,r purchased by districts and referenced to 
their curricular objectives fall In this second category. Tests of these 
kinds are developed beyond the schools. Their administration Is called for 
primarily to meet organizational needs and concerns at higher levels of 
public-education governance. Those who work at those levels may have a 
sense of ownership In these tests; educators In the schools rarely do. 

These two tiers of assessment function quite differently In most 
schools and districts. Teachers and principals rely heavily on the results 
of Internal assessment strategies and consider them Important as they go 
about routine Instructional planning and decision making. At the same 
time, they generally treat Information from external testing as of minor 
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Importance, using It only occaslonany and Idlosyncratlcally. These 
patterns are obvious In both CSE's fleldwork- findings and survey data. 

When teachers were Interviewed during pre-survey fleldwork, they 
discussed all the Information they had throughout the year on students' 
academic capabilities, performance, and progress; they described whether 
and how they used that Information. Collectively, they cited far more uses 
for the Information that came from assessment strategies that were local to 
the school and classroom. (See Table 17, page 560 

Teachers surveyed across the nation were asked to rate the Importance 
of diverse types of assessment results In four routine, decision-making 
tasks. Again, the pre-eminence of the Internal tier of assessment was 
apparent. (See Tables 12 and 13, pages 49 and 50.) Principals In CSE's 
national survey were asked to rate how Important a role data from various 
sources played In eight regular school -level administrative activities. 
Here, the separate functions of the two tiers of achievement assessment was 
especially apparent. Principals reported counting Internal assessment data 
more heavily In making Instructional ly relevant decisions, e.g., allocating 
funds, assigning students, evaluating teachers. But they indicated that 
results of external measures were more Important in reporting to those 
beyond the school, e.g., to district administrators and the public. 
(Review Table 10, page 44). Further evidence of the functional 
independence of the two tiers of student-achievement assessment appears In 
Figures 3 through 6 of Chapter 6. In general, these figures show two 
networks of relationships. One Includes the use of measures external to 
the school (formal tests); the other. Internal assessment techniques 



- 130 - 



(teacher made tests, teacher observations and professional judgments). The 
use of tests In the external tier varies In response to a chain of factors 
that usually Includes the perceived need to emphasize tested and basic 
skins ("basic skills press"); administrators' holding their teachers 
accountable for test- score-bashed currlcular decisions ("currlcular 
accountability") attitudes about test quality; and Information and training 
about tests. None of these factors, however, Influence the use of the two 
most widespread types of school-based, or Internal, assessment — teachers' 
tests, observations and judgments. Instead, teachers' use of the latter is 
tied only to classroom circumstances: to instructional resources that 
permit differentiated instruction to meet students' individual learning 
needs and (less strongly) to resources that save time in testing. (The 
single exception is in high-school English classrooms. Figure 4, where 
teachers' use of local measures does not covary with any of the factors 
included.) 

These findings suggest that external test results become more 
Important to teachers only when something or someone impels or Induces 
teachers to treat them as more important. Instructional circumstances do 
not influence teachers' use of these results. On the other hand, the 
results of Internal assessment techniques are Influence by Instructional 
assessment cirucumstances. When classroom conditions demand and facilitate 
closer, more fine-grained evaluation of students' performance, it iSxthelr 
own, local measures that they weigh more heavily.* 

* Note that the use of curriculum-embedded tests, considered here as 
internal measures, tends to fall between or overlap the two relational 
networks described above. Nevertheless, use of these tests generally 
correlates more strongly with classroom Instructional and testing 
resources than with the factors that influence external tests. 
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Taken together, the research findings just cited show that there are 
notable quantitative differences In the ways the external and Internal 
tiers of assessment are used by educators In the schools. They reveal that 
the results of externally mandated testing serve fewer purposes (Table 17) 
and are not counted as heavily In planning or decision making (Tables 9 
through 13). But fleldwork clearly suggests that there are also sig- 
nificant qualitative differences in how the two tiers of assessment are 
typically utilized by teachers and principals. The results of external 
tests are most often examined briefly, casually, and asystematically. Do 
principals consider the results of standardized and district-objectives- 
based tests in curriculum evaluation? Table 9 suggests that they do. But 
interviews indicate that this often means that they merely glance over the 
scores, mention them in a faculty meeting, and point out the areas In which 
the school did especially well or poorly. (See quotations, page 84 in 
Chapter 5.) Do teachers use standardized test results in planning? 
Apparently they do to some extent (Tables 1 and 2). Fleldwork suggests, 
however, that, more often than not, this means a once-a-year visit to the 
office for a quick look at their students' cumulative files. Are 
standardized test batteries and minimum competency scores consulted in 
student placement? Again Tables 9, 12, and 13 Indicate that they are. But 
visits to schools make clear that they are most often consulted as part of 
an automatic or cursory gate-keeping procedure. Law or policy guidelines 
direct that students with scores below a certain cut-off point be placed in 
a compensatory program or remedial class. Alternatively, as one 
high-school teacher put it, describing a procedure reported by many: 

They give me each kid's standardized- test score on my class 
roster. If one stands out, I usually check with the 
counselor to be sure the kid should really be assigned to 
geometry . 
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Such uses contrast sharply with teachers' recurrent and systematic use 
of assessment techniques that are local to the classroom and school In an 
on-going process of Intructlonal planning and decision making. They 
contrast markedly with principals' serious consideration of teachers' 
advice, recommendations, and grades on teachers assignments In making 
budgetary decisions or next year's class assignments. And they certainly 
do not constitute thorough utilization of external testing data In a 
systematic process of school-wide analysis decision-making, or planning of 
curriculum and Instruction. 

Why do the two tiers of achievement assessment function in the dif- 
ferent ways that they commonly do? The reasons are not hard to find. They 
lie in the Interplay of several factors: characteristics of the measures 
themselves, circumstances surrounding their availability, educators' train- 
ing in assessment, and the organization of educational planning in schools, 
districts, and beyond. 

American educational organizations (schools, school districts, etc.) 
have been called "loosely coupled systems" (c.f.. Deal, 1979; Meyer & 
Rowan, 1978; Ftontjoy & 0' Toole, 1979). Schooling in the United States has 
been described as "pre-industrial a cottage Industry" (Dawson, 1977). 
And teachers in classrooms have been likened to "street-level bureaucrats" 
(e.g., Weatherly & Lipskly, 1977). These similes call attention to the 
relative autonony of the classroom teacher in nwlti leveled decision-making 
hierarchy -- a hierarchy in which participants at each level have interests 
and concerns that only partially overlap, only sometimes coincide. 

For their part, teachers routinely do a great deal of instructional 
planning. They have a major role in planning what to teach (and/or 
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emphasize) and how to teach it, in diagnosing individual students' learning 
needs, and in assuring that students are working at appropriate levels in 
the curriculum. As the school year unfolds, they need to monitor their 
students' progress, to consider whether and how to adjust the pace and 
emphases of their teaching, to grade students and inform parents of 
achievementr-to-date, and so on. To do all this and do it well, teachers 
need assessment tools wth three basic characteristics: (1) Validity 
they must assess what the teacher believes he or she has actually taught In 
a way that seems consonant with the way he or she has taught it; (2) 
Suitability — their intended purposes must fit the tasks the teacher needs 
to accomplish, (thus teachers seek placement, tests for placement, chapter 
and unit tests for monitoring progress and grading, etc.); and (3) 
Immediate Availability — the teacher must be able to employ them whenever 
It seems appropriate to do so and have the results back promptly. In 
short, the assessment tools that teachers need must be sensitive to local 
conditions, to the array of particular circumstances In their particular 
classrooms at the moment. And, in order to function throughout the year as 
the instructional leaders of their schools, principals need measures of the 
same kind. 

It is not surprising, then, that both teachers and principals rely 
heavily on assessment strategies that are internal to the school and its 
classrooms; teacher-made tests and assignments, teachers' observations and 
clinical judgments, and the adaptable, readily available tests that come 
with the commercial ^^riculum materials they are using. From their points 
of view, these Internal measures have all three of the characteristics 
listed above. Externally mandated measures, on the other hand, usually do 
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not. Ihey are not designed primarily to provide data for routine classroom 
decision making. The fit between their contents and format and^a 
particular teacher's curriculum Is problematic. Often, their scores are 
not returned until weeks or months after a?!m1n1strat1on. Often too» the 
results come back In a format teachers and many principals find unfamiliar 
and/or cumbersome. {See Table 19, page 64.) For any or all these reasons, 
the results of standardized tests, other mini mum- competency measures, and 
many d1str1ct-object1ves-based tests can seem remote and irrelevant to 
teachers and principals. In addition, teachers and principals generally 
have limited formal training in testing and measurement or the use of test 
data (See Table 23, page 74.) Further evidence that supports this claim 
will be found further on in the chapter. This also limits the 
accessibility of external testing data to educators in the schools. CSE's 
Test Use in Schools Study fieldwork found teacher and principals voicing 
these very concerns as drawbacks of external testing. (See illustrative' 
quotations In Chapter 5, pages 94 and 95). 

But the very characterlsttcs that mke Internal assessaent tooTs Ideal 
for use In Indtvtdual teachers' and principals' routine work severely 
restrict their utility for systewatic school- and district-wide planning . 
Their content and the timing of their administration is idiosyncratic, 
variable from classroom to classroom. Aggregating the data they provide in 
order to see achievement patterns across grade levels, a department or the 
entire school, therefore, is difficult if not inappropriate and 
impossible. This is especially true of teacher-made tests and assignments, 
but it also often applies to tests embedded in texts and other commercial 
materials. (Teachers time their admini strati on differently; they sometimes 
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adapt their contents. The same materials or text series are not always 
used throughout the school.) And while teachers' cumulative observations 
and experience-based judgments are valuable sources of information, they 
cannot be readily synthesized Into a precise, detailed, picture of specific 
curricular or teaching strengths and weaknesses across many classrooms or 
schools. 

It is these problems with local or Internal assessment strategies that 
have made standardized, minimum-competency, and special disjtrict- 
objectlves-bsased tests attractive to local school districts and make 
similar measures a virtual necessity for states and other educational . 
agencies. By providing standard and consistent data across settings, such 
tests facilitate comparisons among classrooms, schools, and/or districts; 
they permit year-to-year monitoring of performance. They are likely to be 
more sound psychometrlcally than teachers' own tests; In most circumstances 
they are sufficiently valid to indicate broad patterns and trends. Tests 
of these kinds can take time to administer, score and analyze 
comprehensively, but comprehensiveness is important to district and state 
planning, especially if data are gathered only annually or blannually. 
Coming full circle, however, the same features that make these types of 
measures useful to districts and larger education agencies generally limit 
their usefulness for teachers and principals. Thus, two tiers of 
achievement testing, largely distinct In their functions, are maintained in 
public schooling. 

As noted earlier, the next chapter will present research-based models 
and guidelines detailing how districts and schools can begin to Integrate 
these two tiers of testing use both more fully in planning for 
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Instructional Improvement. The remainder of this chapter, however, goes on 
to examine three Important Issues that their separation raises of state and 
national policy makers. 

External Assesswent: $tu4y Findings Raise Issues of Equity 

Chapter 1 explained some of the mechanics through which formal, 
mandated tests (the external tier of assessment can serve as Interventions, 
or agents of educational change. (See pages 6 and 7.) With this "testing 
as an Intervention" hypothesis In mind, CSE sought, to Identify whether 
tests required by agencies beyond the school are In fact Influencing school 
programs and so students' educational experiences and life chances. Among 
the policy questions underlying the Test Use In Schools survey (Chapter 1, 
pages 3 and 4) several addressed the Influence of minimum competency 
testing: What are the Impacts of different kinds of minimum competency 

♦ 

programs? Have they affected curriculum and Instruction? Have they 
wrought changes In the other ways that districts and schools measure- 
student achievement? A second set of policy Issues were raised about the 
formal testing (most often standardized, norm-referenced testing) 
occasioned by the evaluation requirements of state and federal education 
programs: How does such testing affect the Instructional time of 
participating students? How does It Influence the distribution of 
Instructional staff members' energies and efforts? 

Answers to these questions have been offered through the preceding 
chapters. Here, It Is appropriate to review them and to extrapolate their 
implications. 
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MInliMi copetency testing: three potential sources of education 
Inequity . Study findings raise the possibility that differential mlnlmurn 
competency or proficiency requirements from state to state (and in some 
states, from district to district) are generating educational inequities. 

First, there is reason to question whether the tests 1n use, are 
uniformly fair. Substantial percentages of teachers » especially 1n the 
elementary grades and high-school English, think that they are not (Table 
25, page 81). Furthermore, where laws now specify competency tests as 
prerequisites for promotion to certain grades and for high-school 
graduation, both elementary and high school teachers are signflcantly more 
inclined to doubt their fairness and the wisdom of using them as 
gatekeeping measures. (Table 28, page 99.) Put another way, those " 
teachers in the best position to know the tests and to judge how well, they 
function in sorting minimally competent from incompetent, students are the 
very teachers most likely to doubt their equity and desirability. 

htost teachers, of course, are not experts 1n testing and measurement. 
(See the discussion below, pages 128 to 131.) Their judgments of test 
fairness cannot be taken as definite. Nevertheless, the patterns of their 
survey responses should be sufficient to stimulate policy makers' continued 
concern about such issues as f^e instructional validity^ and cultural 
linguistic bias of the proficiency or minimum competency test now in use. 

■ Second, survey results indicate that competency or proficiency testing 
may be generating differences in the frequency of routine classr'^pm 
assessment in high schools. This, in turn, may be producing inequities in 
the quality of instruction. In secondary schools where no state-mandated 
competency tests exist, students spend roughly 62 hours a year taking 
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English tests and 53 hours a year taking mathematics tests (Table 6 , page 
29). Given that tests In these subjects average about a half-hour each 
(Table 3, page 23), this means that the typical student In these schools 
takes an English test on the average of three times a week and a math test 
on the average of two- to- three times a week through 37 weeks of Instruction 
each year. Where proficiency or competency tests are required for 
promotion and/or graduation, however, high-school students average 
half-hour tests In each of these subjects once a week or less across the 
school year.* 

No one knows what the optimal of testing Is, and some would argue that 
testing should be minimized to "save" class time for teaching and 
learning. A number of studies, however, Indicate that frequent monitoring 
of student progress Is an important characteristic of ~iore effective 
schools. (See Purkey & Smith, 1982, for a comprehensive, critical review.) 
Combined with CSE's survey findings, this suggests that policy makers in 
both states and districts should be concerned about the direct and Indirect 
effects of minimum competency requirements on local assessment practices. 
Whether and how these requirements Influence classroom testing should be 
closely examined; research should explore how often testing should 
optimally occur. But if frequent monitoring of students' progress and 
prompt feedback on student performance are features of effective teaching, 
differential competency mandates may be contributing to inequities in the 
quality of students' instruction from one state to another. 

Finally and perhaps most importantly, survey results raise the 
possibility that minimum competency or proficiency testing programs are 

* In states that require tests for promotion/graduation and mandate the 
measure that schools must use, the averages are a classroom English test 
1.2 times per week and a mathematics test once in every seven school 
days. In states that require tests for promotion/graduation but permit 
districts to select or design their own measures, the average is a 
classroom test every seven to seven-and-a-half school da*' .n both 
English and mathematics at the seondary level. ^ ^ 
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working to produce state- to-state differences In the breadth of the 

curriculum that students" experience, especially at the secondary level. 

There is substantial evidence that examinations with Important consequences 

tend to influence the curriculum In schools where they are given (e.g., 

Cronbach, 1963; Linn, 1983a, b; Madaus & Greany, 1982; Madaus & McDonagh, 

1979; Tink^leman, 1966). It Is hardly surprising, then, that teachers in 

„h1gh schools where minimum competency t^jsts are required for graduation 

agree, to a significantly greater extemt than teachers elsewhere, that 

these tests affect the amount of time that they can spend teaching subjects 

and skills the tests do not cover, that they have recently been spending 

more teaching time preparing students for required tests, and that the 

proportion of their schools' resources allocated to basic skills teaching " 

is so great as to detract from the quality of their overall educational 

programs. (Refer to Table 30, page 106 in Chapter 5.) 

Some maintain that tests should influence the curriculum. Linn 

(1983a, p. 125), for example, takes the position that 

a test provides the means of making agreed-upon 
objectives clear and precise. An important goal of 
instruction should be the achievement of those 
objectives as demonstrated by performance on the' test. 

Especially In.-the- case„of--mtnimum_Cfiinpetfiii5xi/L. th^^^ 

many who would agree. Educational policy makers and practicing educators, 
they would argue, should establish clearly and precisely the basic 
proficiencies they expect students to have at various milestones in their 
schooling. Instruction should work toward the achievement of these 
minimal objectives, and students should demonstrate that they have attained 
them through test performance. Indeed, It was arguments such as this that 
promoted the passage of minimum competency, proficiency, or functional 
literacy testing legislation 1n over 40 states. 
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Few would quarrel with the Idea that students should attain minimal 
standards of proficiency In basic skills. But If the perceptions of 
teachers surveyed by CSE are accurate, fpr-promotlon-and-graduatlon 
competency testing requirements may be narrowing the secondary curriculum: 
Inducing districts, high shcools, and Individual teachers to emphasize the 
tested, bd^sic, functional literacy skills at the expense or' other 
learning. Thus, those students In states with these requirements may be 
limited to learning less about advanced composition, and less of the 
analytic and problemrSol ving skills that these subjects entail than 
students In other states with different requirements are learning and 
less than they themselves might be learning were their teachers not 
spending class time working to assure that everyone Is proficient in the 
minimum, tested skills. Perhaps, then, these students -- many of whom 
would certainly pass minimum competency tests in any case are being 
placed at a disadvantage as compared to students in states where 
proficiency testing is not required or required only for diagnostic 
purposes. 

Of course secondary students who fail proficiency tests where there 
are graduation requirements are more likely than others to experience a 
contracted*curriculum. Fieldwork indicates that they are often placed in 
special remedial courses centered on the skills that the tests cover. The 
creation of such courses, however, can mean that fewer sections of more 
advanced courses are available for other students. (States have not always 
provided addtional findings for remediation to accompany competency 
legislation; districts cannot always hire the extra teachers that would be 
needed to both maintain current course offering and staff remedial 
sections.) And while it is certainly important to make sure falling 
students gain minimal competence in basic reading, writing, and mathematics 
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skills, It is also Important to recognize that these skills In themselves 
do not open many doors In an Increasingly high-technology society. 

In short, CS£'s survey findings raise serious questions for policy 
makers about the cost-benefit trade-offs of competency testing 
requirements, as well as questions about their equity. The tests may be 
unfair for many students. They may be reducing the frequency of routine 
classroom testing and (thus) the quality of Instruction. They may be 
narrowing the curriculum and, with It, the range of opportunltes open to 
many students. These possibilities deserve the attention and Investigation 
of all those who shape educational policy at the local, state, and national 
levels. 

Testing for state and federal prograa requlreaents additional equity 
Issues . Study findings also suggest that testing conducted to meet the 
evaluation requirements of federal and state educational programs may be 
Influencing the educational experiences of low-Income students at the 
el ementary 1 evel . 

According to principals' reports, the results of formal tests carry 
more weight and have greater consequences in schools serving low 
socioeconomic status (SES) neighborhoods than In those serving higher SES 
communities. In the former, they count far more J ns^^^^ as planning 

curriculum, deciding on students' class assignments, allocating school 
funds, and reporting to the public, district officials and parents. (Refer 
to Table 11, page 47.) The role played by formal tests 1n these low- income 
schools Is often mandated or enhanced by the special state and federal 
education programs 1n which they participate. Standardized, norm-referenc- 
ed scores are commonly used In low-Income schools, for Instance, to 
establish individual students' qualifications for compensatory education 
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programs. Formal testing plays a part, too, in the placement of 
non-English-speaking and limited-English-speaking students (many of whom 
came from lower SES families) In bilingual programs. These and similar 
programs usually entail evaluation requirements, and these requirements are 
frequently met through formal testing. Thus, as noted earlier (Chapter 3), 
federal and state program requirements help to make test scores especially 
salient In the very schools where more students more often have difficulty 
doing well on formal tests. And, to a significantly greater extent than 
others, teachers In lower SES schools find a greater need to spend 
classroom time on tested, basic skills and preparing students for required 
tests. They are also signflcantly more Inclined to agree that the measures 
allocated to basic skills Instruction are so great as to affect the overall 
quality of their schools' programs. (See Table 29, page 104.) 

Certainly all of the emphasis placed on test scores in low SES schools 
cannot be traced to the presence of state and federal program 
requirements. Nor can the greater attention given tested, basic skills in 
these schools be ascribed solely to their emphasis on test scores. 
Nevertheless, as noted in the last section, tests with important 
consequences can and do influence curriculum, and it is clear that state 

and federal program requirements do help to make test results more _ 

consequential in low SES neighborhood schools. Thus, those who establish 
the requirements for state and federal programs should give careful 
consideration to the role additional emphasis on test scores may play in 
narrowing the curricular opportunities of low-income elementary students, 
which can only add to the disadvantages such students already encouter. 
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Internal Assesswent: Test Use In Schools Sttidy Findings and Related 
Research Raise Issues of Teacher Preparation Test Quality 

While CSE study findings on the external tier of assessment (or formal 
testing) raise educational equity Issues for policy makers, results 
regarding the internal tier of assessment generate concerns about test 
quality and teachers' training in assessment. 

The formal tests mandated by agencies outside the school often play a 
role in major gatekeeping decisions regarding students. But teacher-made 
tests, teachers' daily assignments, and teachers' observations and 
judgments, play at least as great a role in influencing students' 
educational experiences and life chances. Constituting the tier of 
assessment internal to the schools, the results of these techniques are 
critical in schoolwide decision making. They influence curricular 
planning, the distribution of school funds, and students' assignment to 
classroom. They also weigh heavily in what schools tell parents about 
their children's progress. {Review Tables 9 and 10, pages 43 and 44.) 
They are equally important In the classroom. They help to shape teachers' 
planning as the school year begins, significantly affect their placement of 
students in-learning groups, aJ^ ^^^unt most +n their -calculations of 
students' report-card grades -{Tables 11, 12, 13, and 16 in Chapter 3). 
Thus, the various teacher-designed strategies of achievement assessment 
cumulatively shape students' learning environment, academic self-concept, 
educational status, and {ultimately) their socioeconomic opportunities. 

Despite the obvious Importance of teachers' tests, assignments, and 
clinical judgments, studies have repeatedly shown that teachers receive 
little pre-service training in assessment. Reviewing some of this 
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literature In a recent paper, Coffman (1983) wrote: 

In 1959 Mayo reported a study by Noll indicated that 
83% of 80 colleges he had surveyed offered a course in 
measurement, but that only 14% of them required one of 
all teacher education students. Furthermore, only 10% 
of the states required a course for certification. Ten 
years later Stinnet (1969) made no mention of any 
requirement in educational measurement in his 
encyclopedia article on teacher certification, nor did 
Burden (19812) thirteen years later. It seems obvious 
that only a minority of teachers have had any intensive 
training in educational measurement. 

Recent research also Indicates that teachers remain poorly prepared in 

assessment (Rudman, et al., 1980; Woellner, 1979; Yeh, et al., 1981). And 

as CSE's survey indicates, in-service training does little to fill the 

gap. Only about one-fifth of the teachers responding received staff 

development related to selection and construction of good tests or in use 

of test results to improve instruction. 

Very little direct information is available about the quality of 

teacher-developed tests. As the previous paragraph should suggest, 

however, that which is available reveals that teachers lack skill in test 

construction. Ebel (1967) identified a variety of common errors in 

teachers' test and urged better training in this area. In a recent review 

of teacher-made tests, Fleming and Chambers (1983) found that teachers 

write more questions of the short-answer kind than of any other type; they 

rarely devise essay examinations. For the most part, too, the tests 

reviewed required students to recall facts and terms. Questions requiring 

learners to translate, apply, or otherwise use knowledge were rare. 

Furthermore, Fleming and Chambers discovered a "general tendency" to omit 

test directions, to use illegible test copies, and "to omit the point 

values to be assigned to test questions. This trend suggests that teachers 
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may not be visualizing their tests as means for quantifying students' 
performance as a measure of students' learning. This trend appears to 
confirm reports In the 1 Iterature. ..that teachers' knowledge of fundamental 
measurements concepts Is limited" (Fleming and Chambers, 1983, p. 36). 

An In an, It seems worth considering just how qualified today's 
teachers are to be developers of the tests that most affect students' 
nves. How effective are teacher-generated tests In reveanng the 
Insufficiency In Individual students' learning? How vand are they as 
measures of students achievement? How do teachers decide how often to 
test? How skined are elementary school teachers 1n analyzing the 
commercial curri culm-embedded tests that they frequently use? Similar 
questions can also be raised about teachers' skills In making observatlon- 
and Interaction-based judgments of children's learning. 

Given the time spent on teacher-constructed tests and given the 
cumulative Importance both of these tests and of teachers' judgments in 
classroom and schoolwlde decision making, teachers' preparation for the 
role of achievement assessor and their competency In that role need 
thorough review. And this review deserves the attention of both the educa- 
tional policy and the educational testing communities. 



Toward More Integrated And Rational Assessaent Systeiis 
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While they work to examine and (as necessary rectify equity and 
quality problems In our current system of achievement assessment, policy 
makers will be well advised to explore ways for integrating that system and 
making it more national. 
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As the opening of this chapter explained, Test Use In Schools Study 
findings reveal national testing practices which are bifurcated by Internal 
and external needs, replete with overlapping requirements at the federal, 
state and locals levels. The result Is two systems or tiers of testing 
which are redundant and Inefficient. Furthermore, survey findings show 
that significant teacher and student time 1s spent In required testing, 
representing fully half of the testing at the elementary school level and 
one-quarter of the total student testing time at the seondary level. This 
time presumably serves the decisionmaking and accountability needs of 
policymakers, but (as study results clearly show) serves very litte the 
information needs of most principals and teachers and is little used by 
them. Meanwhile, teachers and students spent considerable time taking 
teacher-made curriculum embedded tests -- tests which reflect the 
instructional programs and which serve the classroom decisionmaking needs 
of teachers, but which have little Impact in the policy arena. In other 
words, both teachers and policymakers devote considerable attention and 
resources to testing, but view each others' efforts as Invalid for their 
purposes. 

While several reasons for this mutual rejection have been described 
above,- the- fact remains that both teachers ^ pri nci pals y district 
administrators, and other policymakers require information about same 
phenomia: the academic progress of students and the extent to which 
students are achieving the skills which teachers and schools Intend to 
teach. And while the information needs of administrators and policy-makers 
may differ from those of teachers and principals i.e., needs for 
general izable, comparative information vs. ideographic information which is 
sensitive to local context both share the need for validity. Yet the 
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validity of achievement tests are valid measures of school progress and of 



accountability only under very special conditions: where their content 
matches the specific Instructional Intentions of schools. Ultimately, 
then, the Information needs of teachers and policy -makers may be very 
similar, although their roles and respective responsibility Implies consid- 
erably different levels of specificity and periodicity 1n assessment. 

Given this similarity in essential information needs, it should be 
possible to^lerhgn^ in place of overlapping requirements and duplicative 



efforts, nwlti purpose testing systems which can simultaneously serve the 
needs of both policymakers and local educators. Such testing systems might 
provide very detailed and frequent Information at the classroom level and 
for the local school site, but be combined and aggregated for decision- 
making purposes at other levels. For example, a test might provide a 
teacher with detailed diagnostic information about a student's strengths 
and weaknesses In reading objectives targetted for classroom instruction; 
the results of that test could also be aggregated by instructional group or 
class for classroom decisionmaking, be combined over, time for the class and 
grade for school -level planning and then summarized for district-level 
purposes. Given the common accessibility of micro-computers in schools and 
their capacities for scoring, storage, retrieval, analysis, reporting, and 
transmission, the technology for implementing such systems is available and 
feasible for measures which are common across classrooms and schools. 
Calibrated item banks, anchor items, and meta-analysis techniques may 
someday permit more pecularistic data to be aggregated for decisionmaking 
at the individual, class, school, district, state and federal levels. 
These possibilities deserve exploration now, toward a more rational, 
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Integrated assessment system In the future. 

This is a long-range agenda. In the short-^run however, school 
districts can make a start in . making external tests more relevant for 
school- and classroom-level planing and/or in building internal (classroom) 
tests that are useful in schoolwide and districtwide planning and decision 
making. The final chapter of this monograph describes some productive 
models that districts can follow toward these ends. 
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CHAPTER 8 

DIRECTIONS FOR POLICY AND PRACTICE AT THE LOCAL LEVEL: 
LINKING TESTING WITH INSTRUCTIONAL PLANNING AND IMPROVEMENT 

In^explainlng the policy orientation underlying the Test Use In 
Schools Study, Chapter 1 listed several questions that are extremely comtnon 
among and urgent for policy makers in local school districts. To restate 
those concerns here: many school districts are expanding their own testing 
programs, from district to district, however, teachers may differ in their 
willingness to administer these tests and to utilize their results. Under 
what conditions, then, are district tests most likely to be administered 
and used? What questions should tests have in order to make them 
attractive and useful from teachers* points of view. How can district 
testing be effectively Integrated with other assessment activities? 

This chapter suggests answers to these questions as it addresses a 
somewhat broader one: How can districts and schools make more effective 
use of test results in instructional planning and improvement? The models 
and guidelines presented below are derived not only from the general survey 
and detailed fieldwork findings of the Test Use in Schools Study, but also 
from the on-site case studies of a complementary CSE project which examined 
district organization and management strategies for promoting test use 
(Bank & Williams, 1981a, 1981b, 1983). 

These field studies demonstrate ways in which the utility of both the 
external and internal tiers of assessment (as described at the outset of 
Chapter 7) can be enhanced in local decision making and in planning for 
instructional improvement. 
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There are, the data suggest, two approaches that districts can follow to 
accomplish this goal . One approach Is to build from the 1 aside out ; to 
construct district tests that have the characteristics of internal 
assessment tools — the validity for local curricula, suitability for 
routine classroom purposes, and immediate availability that appeal to 
teachers -- and at the same time provide consistent, reliable data that can 
be aggregated in ways useful for school and district decision making. The 
second approach Is to build from the outside in ; to analyze information 
from externally mandated measures currently given in the district and 
deliver it to schools at times and In formats that maximize utility In 
planning for currlcular and instructional improvement. 

These approaches are not mutually exclusive; both can be followed 
simultaneously. But the effectiveness of either depends upon more than the 
proper handling of testing and test scores. It also depends upon district 

4 

systems that structure and support the use of testing information in an 
on-going planning process systems of a type that are not widely present 
in most districts today. 

On the whole, as has been shown, most districts do not routinely 
return test results to schools in ways that facilitate their use in 
decision making. Administrators review scores for the faculty in most 
schools, but rarely on a periodic basis as part of routine procedures. 
Follow-up to assure that teachers are giving attention to the content area, 
skills, etc., that test scores indicate need emphasis is rarely routine, 
either. (See Table 20, page 65.) Survey data show that the majority of 
teachers are Instructed in how to administer tests und that they are 
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Informed about test results. Yet 1t appears that few receive training In 
how to link teaching and testing or In how to use test results In Improving 
Instruction. (See Chapter 4, Table ,23, page 74.) These are only some very 
general Indicators that not many districts are closing the 
testing-instruction loop with systematic planning mechanisms. They are 
supported, however, by fieldwork from both the Test Use Study and the other 
CSE project mentioned above. Furthermore, even though efforts of the kinds 
shown in Tables and are only the most elemental In a district 
testing-Instructional decision making linkage system, they can make a 
difference in how teachers view and use testing. Analyses of survey data 
show that where there is more support by district and school leaders for 
the use of test results in planning, and where there is more staff 
development in assessment, teachers have a significantly more positive view 
of testing and its uses, and they also tend to treat the results of 
district-objectives-based, standardized, and even mini mum- competency tests 
as more important in instructional decision making. (Review Table 31, pag 
114.) With this in mind, discussion turns to some ways that districts can 
create successful links between testing and planning for Instructional 
Improvement in their schools. 
Bunding Links Frow the Inside Out 

Districts that follow this approach build outward from classroom 
assessment needs to those of the school and district. They also build from 
what should be taught to what should be tested. First they construct 
district curricula, then district tests to match. 

Two of the districts studied closely by CSE's projects were especially 
successful in taking this approach. Their slightly different testing- 
instruction linkage systems are useful models for others. 
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The Central CIV Hodel* 

Located 1n the rural midwest, Central City School Di'trlct serves 
about 5,000 students In seven elementary schools, three junior highs, and a 
high school. It has a long history of Innovation and commitment to curr1- 
culum development. It also has a group of teachers who pioneered use of 
the high school's main-frame computers (originally purchased and used for 
computer-assisted Instruction) In the scoring and analysis of teacher-made 
tests. These factors, and an energetic leader, joined In the creation of 
Central City's system for linking test Information with Instructional 
planning. 

The test Inforwatlon . Each summer \x\ recent years, the district has 
sponsored curriculum development projects. But while the district 
Initiated, compensated, and guided. It was teachers who ^^(^ the work. 
Several representatives from the faculties of each school were selected by 
their peers to participate. 

Efforts began with the construction of an elementary-grade media (or 
library) skills module and continued through the development of complete 
mathematics and social science curricula for the elementary grades. Later, 
the mathematics curriculum was extended through grade 9 and work began on a 
reading program. In each case, development was done unit by unit in 
several stages. First, teachers decided on instructional objectives and 
selected and/or wrote materials and learning activities rni "Tn'^iHinJjiU 
them. Then, pre-and post- tests referenced to the objectives of each 
unit were designed and "mastery levels" for each objective were specified. 
Units and accompanying tests were piloted the next year; objectives, 

* The district names used here are pseudonyms. Any resemblance betwen 
these names and those of actual districts and communities is unintended. 
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materials, and test Items were revised 1n light of teachers' criticisms and 
suggestions. Further revisions incorporating teachers' feedback were made 
after the units went into general use in schools across the district. 

Testing materials were designed such that all the unit tests could be 
scored and analyzed by computer and returned to the teachers in a day or 
two. Results came in the form of a set of easy-to-read sheets, one for 
each student. The sheet listed each objective covered on the test, the 
number of items that measured the particular objective, the number of these 
items the student had correct and Incorrect, and whether the number correct 
equaled "mastery." At the top of each sheet appeared a paragraph that 
described the types of errors the student had made and summarized the types 
of difficulties the student seemed to be having with the skills or content 
covered. 

In mathematics, the district had selected a sample of items from the 
unit tests and combined these to create mid-year and end-of-the-year 
sipnary measures given to students in all schools. Teachers received 
summary sheets of the type described above for these tests, too. (The 
district was considering developing similar tests in other subject areas 
once the process of curriculum and test-item revision was considered 
compl ete. ) 

All this applies to the lower grades, but similar developments had 
begun in the high school mathematics department. These were Initiated by 
,.th^ teachers, who had worked toward common curricula and devising 
computer-scored tests for various courses. 'In line with a general district 
attitude, other departments were encouraged, but not required, to follow 
this example. 
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The end results of the district-wide effort were several: (1) curri- 
cula that were consistent across the district, that teachers were Invested 
in, and that teachers actually used; (2) a system of tests that fit the 
curricula and provided timely Information in a form appropriate for a vari- 
ety of routine Instructional decisions; and (3) a body of test information 
that was valid and consistent from classroom to classroom and could thus be 
aggregated and compared in school and district planning. 

The structure of school decision ng . Within the schools, these 
test data came into play in two main ways. First, they were routinely used 
by teams of teachers in regular "unit" meetings. Elementary-school "units" 
included several teachers lone of whom was chosen as unit leader), a clus- 
ter of students across two or three grades, and occasionally an instruc- 
tional aide. Students were often divided among unit teachers in different 
groupings for different subjects based on their current level of achieve- 
ment and rate of learning. (Some schools, however, tended to use the 
self-contained classroom approach in some grades). 

Unit teams met at least weekly during release time at the end of an 
abbreviated school day. At the beginning of the year, they discussed 
students' placement and planned instructional emphases and pacing. Later 
on, they routinely examined students' progress, reviewed their placements, 
re-evaluated and altered their teaching, and discussed individual learner's 
problems and how best to address them. Data from district tests, as well 
as other available information, were routinely examined as these matters 
were considered. Unit meetings, then, were the ')r1mary setting for linking 
test data with instructional decision making. (WheVe classrooms were self- 
.ntained, teachers reported using the district tests Individually, as well 
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as in unit meetings. And similar procedures were followed In the junior 
high and high school math departments.) 

A second use of district test data occurred periodically as principals 
established school goals and agendas for school In-service activities. 

District support systews . The linkage effort described above was 
supported by the Central School District in a number of ways. 

First, district leaders initiated and provided resources for the 
curricul um-and-test development. They also gave release time for weekly 
unit meetings In which the test data were used for Instructional planning. 

Second, district administrative leaders provided staff development in 
curriculum writing and test development. Originally, these weekly, 
semester-long, courses were led by professors from a state university. 
Later, however, the district encouraged teachers to take over the classes: 
to revise them, make them more practical and relevant for district staff, 
and then to teach them. Credit on the district's pay scale was given for 
participation in these classes. 

Third, district administrator guaranteed on-going technical assistance 
by maintaining close contact with the nearby Intermediate Educational 
Agency (lEA). lEA help was routinely sought on problems in test develop- 
ment and on scoring-and-analysis Issues. The lEA also provided some staff 
development in instruction. 

Fourth, the district maintained media centers staffed by instructional 
specialists in each school. Specialists helped unit teams and individual 
teachers locate supplementary teaching materials to address learners' 
needs. They also offered training in such areas as instructional diagnosis 
and prescription. 

/ 
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Fifth, a district administrator worked with teacher committees In 
piloting curriculum units and tests, eliciting teachers' crttiques, and 
revising objectives, materials, and test 1 terns « 

It was this same administrator who encouraged continuing and broaden- 
ing the use of the computer-scorlng-and- test-analysis process. 

The Shelter Srove Model 

The Shelter Grove Unified School District is located in the 
southwestern region of the country. Until three years ago, Shelter Grove 
was an elementary school district. The recent merger with a local 

♦ 

secondary school district brought Shelter Grove's enrollment to about 
5,700. These students are distributed through four elementary schools, two 
middle schools (grades 6-8), and a four-year high school. 

Sheltei: Grove's system for linking testing with Instruction is similar 
to Central City's in several ways. Yet it is different enough to be worth 
description as a second "inside-out" model. 

The test inforwatlon . Like Cer.tral City, Shelter Grove adniinisters 
tests of several types. But those that have the greatest power to influ- 
ence instruction in Shelter Grove schools are those developed by the dis- 
trict and referenced to its continua (or sequences) of instructional objec- 
tives in reading, mathematics and writing (composition). 

Shelter Grove Initially contracted with a commercial firm which pro- 
mised to write test items for district-selected objectives and to provide 
computer printouts of scores. Introduced in the early 1970' s, these tests 
failed to win teacher support. Teachers complained that the tests were not 
coordinated with anything that was taught. They also found that they d1d 
not know what to do with the results. 

16.') 
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Teacher coimnittees were appointed to try to revise test Items. They 
responded to the perceived to align the need coordinating tests with their 
curriculum by beginning to work on a district-level continuum of 
objectives. From then on Shelter Grove's experience paralleled the more 
recent history of Central City. By the late 1970' s, teacher committees had 
devised continue of objectives and accompanying criterion-referenced tests 
for reading and math, as well as similar tests for language arts. More 
recently, a district writing continuum was established. 

Unlike the Central City materials. Shelter Grove's tests do not serve 
as unit pre-tests or post-tests. And except in written composition, dis- 
trict objectives are not accompanied by district-designed materials or 
recommended learning activities. Rather, the continua are aligned with 
the commercial reading and math text series used districtwide. 

The district tests were routinely administered to students ty 
classroom teachers on two or three occasions between October and February. 
Scores were aggregated by the district's Testing Coordinator for individual 
students, instructional groups, entire classes, and the school. These 
profiles were sent to the schools in time for planning days that occured 
regularly at several points through the year. 

In addition, proficiency tests composed of various segments of the 
district's criterion-referenced tests were administered to children in 
grades 4, 5 and 6 each year in April and May in accordance with state 
requirements. 

The structure of school decision Making . District tests were rou- 
tinely used in each elementary and middle school during planning days that 
occured at several points in the school year. (The system had not yet been 
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introduced 1n the district's high school.) Two of these days were In 
June. On the first, the program of the school was routinely evaluated by 
the entire school staff looking at the group, classroom, and total school 
scores. These sessions functioned as a needs assessment for the next 
school year. On the second June planning day. Individual teachers placed 
students In appropriate learning groups for the coming year using the 
test-result profiles on each student. 

In September of each year, test Information was updated; Information 
on students new to the district was added. In October, teachers met with 
their principals to set learning goals — benchmarks on the continuum that, 
based upon past performance profiles, t^ey expected the children In each 
Instructional group to meet. 

A mid-year evaluation took place each February. Summary reports on 
current-year testing were run, distributed, and examined. Principals met 
with teachers, as well as with the Superintendent and Assistant Superinten- 
dent for Instruction, to discuss students' progress. Plans for modifying 
the Instructional program were made at this time. Then, In June, the cycle 
began anew with reference to the again-updated test-score profiles. 

Individual teachers also used criterion-referenced test information in 
reporting to parents each October and again each spring. Report cards 
listed continuum skills on one side and noted students' progress toward 
each objective. And each May, letters were sent to the parents of children 
who were two grade levels behind expected performance; special conferences 
with these parents were also arranged. 

District support systems . As was the case in Central City, a number 
of district activities and programs helped to sustain the linking of test 
data with instructional planning in Shelter Grove. In addition to the dis- 
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trict's leadership and resources in developing the Instructional-objectives 
contlnuua and criterion-referenced tests, these included the following. 

First, the district maintained a Professional Development Program 
(POP) that provided teachers with the skills necessary to act upon the test 
results. Coordinated by a full-time specialist, the PDP had evolved over 
time based upon the Madeline Hunter orientation to teaching. Level One 
activities (for all new teachers, aides, and substitutes) dealt with such 
basic teaching skills as understanding goals and objectives, motivation and 
reinforcement, and task analysis and diagnosis. Level Two activities 
(which were not required but encouraged, and which many teachers joined) 
extended those of Level One with emphasis on individualizing instruction. 
Strategies for meeting affective needs, using inquiry skills, and teaching 
specific curriculum content were also covered. (Prior to the general 
implementation of this PDP program, all principals had been required to 
take the Level One course plus courses in clinical teacher supervision.) 

The program required teachers to apply PDP skills in their own 
classrooms, with supervision and feedback from the PDP coordinator. 

Second, learning specialists conducted demonstration lessons, 
recommended materials, conducted diagnoses of new students, and assisted 
teachers in planning and placement when new criterion-referenced test 
scores arrived in the schools. The learning specialists were considered 
master teachers, and regularlj played an Important role in helping teachers 
use test Information. They also explained changes in the continuum or 
changes in district policy to the faculty. With the PDP, learning 
specialists were perceived as critical supports to the district's linkage 
effort. 
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Third, a Testing Advisory Committee composed of a principal and 
several teachers continually updated and improved the district's tests In 
light of teacher criticisms. This group also handled whatever 
administrative and technical problems arose In testing, scoring, and 
reporting results. 

Fourth, ad hoc continuum revision committees made up of teachers and 
learning specialists were paid during the summer to revise sections of the 
continua as seemed appropriate. 

In addition to these formal organizational features, a variety of 
other networking activities (e.g., principal observations, learning specia- 
lists' visits to classrooms, monthly meetings of a district communications 
council) helped district personnel work closely together in maintaining 
links between test data and instructional planning in the Shelter Grove 
schools. 

Guidelines 

The experiences of Central City and Shelter Grove, especially in 
contrast to those of two other districts with similar but less successful 
linkage systems (to be mentioned below), suggest a number of guidelines for 
other districts to follow in linking testing with instruction from the 
inside out. 

1. Build curriculum and assessment measures together "in-house ." 

Administrators and teaching staff in both districts believed very 
strongly in the district development process. They felt that it helped 
assure teacher "ownership" and confidence in both curricula and tests; 
ownership and confidence, in turn, seemed to be Important prerequisites for 

teacher use. Shelter Grove's unhappy experience with tests built outside 
the district, even when they were developed to district specifications, 
E£l£ supports this wisdom. 17 
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2. Assure a close fit between test items and curricular objectives and 
materials . 

This can best be done by designing curriculum first and then the 
tests, as was done in Central City and, ultimately, in Shelter Grove as 
well . 

Teachers are inclined to see district objectives-based or criterion- 
referenced tests as a burdensome irrelevancy If this condition is not met. 
New Branford, an urban district with 30,000 enrollment 1n the northeastern 
United States, attempted to devise criterion-referenced tests keyed to its 
district reading and math objectives. But when Test Use in Schools 
researchers visited New Branford schools, they found that few teachers used 
there tests. Continuum objectives were intended to fit with all of the 
five or six math and reading series used across the district. In fact, 
according to teachers, they fit well with none of them. Thus, teachers 
continued to use the tests included with these commercial series to get the 
information on achievement they needed and they also had to give 
district tests to comply with district requirements. But Information from 
the latter was rarely consulted, and teachers resented the mandate to give 
them. For similar reasons. Central City teachers neglected their 
district's objectives-based reading tests, although they were generally 
enthusiastic about those in the other subjects, developed years earlier 
with little teacher participation and 'Without accompanying curriculum 
materials, [Teachers complained that the reading tests,] were no longer 
valid for the two basal reading series used in Central City. 

3. Strive for maximum teacher Involvement , 

To help build curriculum and tests that teachers own and use, 
teachers' participation in the development process must be more than nomi- 

17 i 
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nal. Both Shelter Grove and Central City Included many teachers on their 
development committees; these teachers, did the real work of constructing 
the curricula {or continua) and the test items. Mechanisms wet-e provided 
that allowed all district teachers to offer feedback on a regular basis. . 
Their criticisms were taken seriously in the revision process. 

In contrast, New Branford (mentioned just above) and Metro. District ' 
(another urban district studied by the CSE Test Use Project) had only a 
small number of teachers on district advisory committees as they construct- 
ed continua of objectives and accompanying tests.. These teachers did not 

n * *" 

participate in the actual development process; their presence was not 
visible to district faculty; they had little Impact on the tests that 
evolved. And in neither district did teachers feel the objectives or tests 
were completely suitable. New Branford teachers' response has been 
described. Teachers' response to Metro District's tests was quite mixed. 
4. Construct tests that cover the entire range of skills in the curriculum 
and/or continuum of objectives . 

The district tests of Central City and Shelter Grove i'^cluded items 
that assessed students' performance on. skills and content from the most 
elemental to the most advanced in the subject areas tested. Metro District 
(enrollment over 100,000), in contrast, purchased test| for each grade 
level in reading, math, and language arts that covered only the simplest 
skills to be taught. In the economically disadvantaged neighborhoods where 
more students had trouble with these skills, test results did help teachers 
identify the skills which Individuals and class groups needed remediation. 
But in these schools, the tests also functioned to push the actual 
curriculum in the direction of the most elemental skills. Teachers 
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and principals wanted students (and their schools) to do well on the tests 
each spring. Thus, they spent much time drilling and re-drilling children 
on the elemental skills tested. Simultaneously, they gave shorter shrift 
In their teaching to other skills specified for the grade level, which were 
not included on the test. Elsewhere in the district, where students 
routinely obtained 90 percent to 100 percent correct on these same tests; 
they yielded little diagnostic or placement information for teachers. 

One^ moral of these contrasting stories, then, is test what you want 
teachers to teach, because teachers will place their teaching, emphasis on 
what you test. 

* « 

Several other "do's" and "don'ts" can be abstracted from the Central 
City, Shelter Grove, and similar but less successful models* These, how- 
ever, are equally pertinent to the "outsfde-in" linkage approach discussed 
next. Thus, they will be omitted here and mentioned in the concluding 
summary. 

Building links Frew the Outside In 

Districts that follow this approach adapt information from externally 
mandated tests to suit the district's and/or schools' planning needs. In 
so doing, they support school -level planning structures and procedures, 
just as districts taking the inside-out path do. 

The testing-instruction linkage systems of two districts that followed 
the outside In approach are described below. They provide very different, 
but equally instructive models. 
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The St. John Model 

The St, John School District covers a wide geographic area of suburban 
and semi-rural municipalities In a Western state. Its 72 schools serve 
between 40 and 50 thousand students In grades K-12. 

Linking testing with Instructional planning began in St. John during 
the mid-1970' s when the state legislature enacted a program intended to 
stimulate local planning for school improvement. Participation in the 
program was voluntary, but over the years most of St. John's elementary 
schools, along with two of its junior high schools and one high school, 
elected to participate. The district encouraged this involvement; in turn, 
the schools' participation stimulated district efforts to provide test data 
for use in local site planning. 

The test inforwatlon . Long before the advent of the state-sponsored 
school improvement program, St. John School District had required adminis- 
tration of the Iowa Test of Basic Skills. Students bsert tested each 
January in grades 2-6. The purposes this information had served previously 
are not germane here. But once numerous St. John schools joined the state 
program, test data became especially important for them. Guidelines for 
the state school -Improvement planning process required that in establishing 
improvement plans schools specify: (1) the "existing level of performance" 
in a particular area, (2) the "needea program changes or additions," (3) 
improvement objectives, and (4) activities to measure these objectives. 
Major activities to be undertaken in pursuit of each objective also had to 
be described, along with budgets and other improvement program teatures. 
But the ^our requirements enumerated here were those that called for "hard 
data" such as test results. 

177 
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It seemed reasonable use ITBS results 1n developing these improve- 
ment plans, yet district administrators realized that these results came 
back from the test publisher in a form that was cumbersome. Computer 
printouts presented the results for each sub-test area for each grade for 
each year on a separate page. Principals and teachers found these reports 
complicated as well as overwhelming in volume. Consequently, the district 
undertook development of what it now calls the Academic Perfornance Profile 
(APP). 

The APP gave each district elementary school an annual overview of its 
ITBS test results for all years and all grades for a particular subtest 
(e.g., reading comprehension, math concepts, etc.) on a single page. This 
reduced fifty pages of compjter printout to approximately six, ordinary 8^ 
by 11 inch pages. 

In addition, the APP s^implified the format in which the information 
appeared. Simple graphs were devised to visually display : (1) the scores 
of student groups as they moved through the grades (1982 first graders as 
second graders in 1983, etc.); (2) the performance at various grade levels 
in various years (the fourth grade in 1981, 1982, 1983, etc.); and (3) the 
gains (indicated in terms of grade-level growth) realized from one year to 
the next for the various grade levels (the gains made by, the 1982 
second-grade group a? third graders in 1983). Two simple tables on Qach 
page (that is, for each sub-test) supplemented the three-line graphs. 

Since the state program guidelines also called for annual needs 
assessment, tne St. John District created survey questionnaires for staff, 
parentb, and students. Ttiese solicited respondents' perceptions of: (1) 
the effectiveness of schools' various programs 1 and (2) how much attention 
should be given to improvement in each program area. Each school 

/ 
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could add up to 20 questions to the set used in conmion across the 
district. Surveys were administered annually in the spring of each year. 
The district's evaluation office tabulated survey results for each, school 
and returned them in a concise form. 

The structure of school dejislon waking . The state's school improver 
ment program mandated the creation of a School Planning Council (SPC) in 
each participating school. Guidelines directed that the SPC membership 
include the principal and elected representatives of the teacher^s^ of other 
school staff, of parents and other community members, and (at the secondary 
level) of the student body. This group was assigned central responsibility 
for establishing needs, goals, and activities for school improvement, as 
well as for budgeting the state funds provided to the school for improve- , , 
ment activities. 

St. John's district evaluation specialists, however, elaborated on 
these state requirements. They urged their schools to also create 
"component committees," smaller groups (including SPC members and others) 
who were charged with planning for improvement in particular areas — in 
each subject area, in school environment, in human relation, in staff 
development, eic. 

Component committees reviewed the ITBS/APP summary forms, survey re- 
sults, and other information. They specified and documented needs, set ob- 
jectives, and developed school and classroom activities to realize them. 
They also stated how achievement of the objectives would be evaluated and 
proposed a budget suitable for their plan. In a next step, various compon- 
ent committees presented their particular plans to the School ' Planning. 
Council. The SPC accepted or suggested changes In each improvement-plan 
component and made decisions regarding final allocation of state program 
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dollars among the various components. The SPC also monitored implementa- 
tion of the plan through the coming school year. 

While plans were routinely developed for a three-year period, revi- 
sions were made each spring bas'ed on information gathered during the cur- 
rent school year. Thus, school improvement planning was an annual process 
centered in the spring, but implementation of plans and SPC monitoring 
occured continuously during each school year. 

Interviews with participants and observation of planning meetings 
indicated that test data (and survey results^) were used in deciding upon 
and substantiating needs, specifying objectives, evaluating implementation, 
and revising the plans. SPC members also rotitinely referred to this 
Information in making and justifying budgetary decisions. 

District support systems . The St. John School District supported Its 
testing- instruction linkage system in many of the same ways that Shelter 
Grove and Central City supported their quite different models. 

First, staff development in the organization and process of planning, 
including the use of the ^P9 test summaries, was conducted for 600 district 
personnel during their first year in the state program. Others received 
this Introductory training as they entered the program. Furthermore, 
teachers, principals, and parents agreed that the regular availability of 
the districts' two evaluation specialists was a key to the program's 
maintenance. They rou'.inely provided staff development and answered ad hoc 
questions regarding planning. and test-data use. 

Second, St. John maintained a comprehensive staf f-cTSvelopment program 
in instructional techniques, which evfryone a,greed was a major factor In 
facilitating the realization of school plans. 
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The Bayvlew Model 

Bayview is a community of 100,000, and is located about 50 miles from 
a major Western metropolitan area. The Bayview Unified School District's 
sixteen elementary schools, four junior highs, and three senior highs 
enroll 14,000 students. 

Bayview' s six-year-old effort at testing-instructional linkage was 
more diffuse than that in most of the other school districts visited by CSE 
researchers. Interest in testing and evaluation was relatively new, and 
many in the district were as yet skeptical of their value. Nonetheless, 
the need to comply with externally mandated testing programs stimulated a 
small group of district administrators to try to make greater local use of 
the test scores they yielded. Only one of these uses will be discussed 
here. It offers an example of "outside In" testing-Instruction linkage 
that is quite different from the St. John School District's model. 

The test Infomiatlon . Three different achievement testing programs 
figured In the Bayview linkage system described here. The first of these 
was the State Assessment Program (SAP). This half-hour test was 
administered each spring to students In grades 3, 6, and iO in accord with 
state requirements. The test was devised by the state and referenced to 
objectives common to many state-approved text series. Items were matrix 
samr ed; not every student was asked to respond to identical questions. 
Thus, data for Individual students were not reported. Results focused on 
grade-level and school patterns, 

A second test used by Bayview was the norm- referenced, standardized 
Comprehensive Tests of Basic Skills (CTBS). The district had just begun to 
require this test in all schools for grades 1-9 when CSE fieldwork was 
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conducted. Formerly, it had been given only in schools with Title I {now 
Chapter 1) compensatory education programs. 

The district's proficiency (or minimum competency) testing p'^ogram was 
also used in testing-instruction linkage. Forms for grades 5, 9, .0, and' 
11 had been developed with the help of consultants to meet the stat^Vs 
mandate. These measures covered reading, writing, and mathematics : ills 
deemed essential for "life coping." The current forms of the test were 
introduced in 1978. 

The declslon-waktng structure . The data from these three tests v^ere 

.brought to bear on instructional planning in several ways by Bayview lis- 

I 

trict leaders. Chiefly, however, they had begun to use the three tesf pro- 
grams mentioned above as content for stjiff development course work in|task 
analysis and diagnostic-prescriptive teaching. 

District leaders had won grant funds from the state to create a | 
Professional Development Center (PDC). The primary focus of the PDC'I; 

< 

program was the continuing d elopment of effective teaching strategljjs. A 
Teacher Center funded by a federal grant augmented the PDC. Curr1cul;jm 
development and the translation of educational research for practicalj, 
instructional applications were the central thrusts of the Teacher clnter's 
program^- The very preserc: of these two centers testified to Bay vi el's 
emphasis on teach ing-effu'Ctiveness skills. In addition, principals I/ere 
required to attend, workshops dealing with supervision, and these focLsed on 
the elements of effective^eaching. 

It was in the context of Increasing external test mandates and the 
emphasis on staff development that Bayview's linkage system began to take 
shape. From the perspective of District leaders, Bayview teachers and 
principals were not facing the issues raised by the District's relatively 
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poor performance on the external measures. In response, said the Director 
of Staff Development: 

We [at the central office] tried to model a problem-sol ving 
way of looking at It so principals could do similarly In 
their schools. The Director of Instruction worked with 
principals In the way he wanted them to work with teachers. 
Also, we asked teachers If they were addressing areas of the 
test. They said they were. When we observed, we found 
teachers had difficulty defining the skills to be taught as 
well as diagnosing for these skills. As a result, we built 
task analysis cycles Into our Professional Development 
Center programs focusing on the low scoring skill areas 
Identified by the State Assessment Program. 

The district's cadre of leaders began by training principals to ex- 
amine SAP (and later the other tests mentioned earlier) to see what 
specific skills they assessed. Once these were Identified, the next step 
was for principals and faculties to examine their school's curricula in 
order to determine whether these skills were being taught and if so at what 
grades and with what emphasis. Staff development provided principals, and 
later teachers, with the information and techniques they needed to do 
this. 

This was taking place with varying degrees of thoroughness in dif- 
ferent Bayview schools when CSE staff members visited the districi:. At the 
same time, areas of curricular and instructional weakness distrlctwide had 
been identified by district administrators. These areas were then targeted 
for sessions on diagnostic-prescriptive teaching and other instructional 
skills. 

Analysis of test results also suggested areas for emphasis in the 

development nf continua. Citing the impact of prof1ciency-test jkill and 

score analysis, tor e;tample, the Bayview Coordinator of Curriculum said: 

The proficiency exam has helped the district focus on 
* curriculum... [We learned that] in math we teach confutation 
but the test tests applications through story problems. 
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Thus, in the Bayview Unified School District, task analysis of tested 
skins served as the basis for a comprehensive examination of the dis- 
trict's curricula and suggested areas of curricular weakness. Simultane- 
ously, analysis of test results led to the identification of teaching weak- 
nesses. Links between testing and instruction were generated through the 
development of district-wide objectives and in Professional Development 
Center and Teacher Center programs. 

Guidelines 

The St. John and Bayview districts had put in place very different 
kinds of systems for linking the results of externally mandated testing 
with instructional planning in their schools. Nevertheless, It is possible 
to abstract a number of guidelines from their "outside-in" models. Other 
districts would be well advised to bear these in mind should they chose to 
follow the outside-in approach. 

1. Make test-score data comprehensible for teachers and principals . 

Providing test results in a format that facilitates their use is obvi- 
ously a key to testing-instruction linkage. That professional educators 
working in the schools can be bewildered and intimidated by reports of 
scores from externally mandated measures was clear in Test Use in Schools 
Study fieldwork (cited early on in this paper). It was equally apparent in 
the early experiences of district administrators In both Bayview and St. 
John. The latter addressed this problem by translating the scores into 
succinct, easy-to-read, and relevant tables and graphs. Bayview dealt with 
it by teaching principals and teachers to dissect the tests and test 
resul ts. 
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2. Train teachers and principals to use test scores as diagnostic tools . 

As noted earlier, the results of externally mandated tests are 
commonly used in a brief and casual way to get a general comparative 
reading on group performance. The essence of their use In the St. John and 
Bayview systems was diagnostic. They played a role in identifying patterns 
of strength and weakness In particular content areas and skills. They 
served to stimulate questions such as "Why are we scoring as we are scoring 
In this curriculum area?" and "How can we improve?" Diagnostic uses are 
not routine in most schools. Simply presenting test scores in clear, 
readable format does not mean that diagnosis of currlcular strengths and 
weaknesses will occur. Teachers need instruction and practice in 
analyzing the different factors that underlie test performance. They need 
instruction and help in abstracting meaning from scores. Survey findings 
suggest that most districts do not provide this. In different ways, both 
St. John and Bayview did. 

3. Expect that results of externally mandated tests will serve as only one 
source of information in planning and decision making . 

Wisely, neither Bayview' s cadre of leaders nor St. John's district 
evaluation specialists tried to make test results the sole basis for edu- 
cational decisions. Human values and priorities do and should influence 
decisions about what objectives to pursue in school Improvement or to build 
Into district continua. The day-to-day experiences with students that 
teachers and principals reiy upon so heavily are very relevant in making 
instructional decisions. These factors were routinely accepted, along ;^1th 
test data, as bases for decision making by St. John administrators as they 
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assisted School Planning Councils and reviewed their plans. Bayview's 
Coordinator of Staff Development, too recognized that test data needed to 
be examined in light of other factors as he explained, "When we see through 
our task analysis and curriculum review what we are and are not teaching, 
the next step is to ask, 'Do we or don't we want to teach this? How 
Important is it for our students?'" 

Data from externally mandated tests can serve to identify problems, to 
support or disconfirm experience-based judgments, and to stimulate ques- 
tions. It can be used to justify or rationalize decisions that have al- 
ready been made. But as the separate experiences of St. John (recall their 
needs assessment questionnaires) and Bayvlew (recall their juxtaposition of 
multiple measures to district curricula) Indicate, test data in themselves 
are only one important source of information for educational planning. 

Suimary and Conclusions 

CSE's national survey and its fleldwork in two research projects 
suggest that both testing that is internal to the school and that which is 
externally mandated can be used more fully in systematic educational deci- 
sion muking. Districts can build a curriculum and tests that can serve 
teachers' routine classroom needs and simultaneously provide consistent, 
reliable, and valid data for school and district planning. Districts can 
also capitalize upon data from externally mandated testing by adapting it 
to local needs. No single approach or model will be appropriate to every 
setting. But whether a district chooses to pursue linkage from the inside 
out or from the outside in, there arp several factors that seem necessary 
for success. 
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One of these 1s district leadership . In each district studied by CSE, 
there was an individual or a small group in the district office -- idea 
champions and supporters -- who were vitally interested in using test data 
in Instructional planning and decision making. CSE's national test use 
survey substantiates that such leaders make a difference In school -level 
uses of test information. 

A second element in district success is an organizational arrangement 
-- a setting and set of procedures — for decision making . In Central City 
schools there were the weekly meetings of unit teams; in St. John, regular 
sessions of the School Planning Councils. Shelter Grove held its princi- 
pal-teacher planning days in June, October, and February each year. In 
Bayview, the locus of linkage was staff development workshops, continuum- 
building committees, and regular school faculty meetings. These organiza- 
tional arrangements motivated and structured the use of test results by 
creating (1) real needs for information, and (2) procedures by which the 
implications of test-score patterns could be discussed and acted upon. 
None of the districts with successful linkage systems simply offered 
schools test data and left their use to chance.' 

Third, each of the districts managed testing and/or test results such 
that they increased the marginal utility of test informatio n ^ te achers 
and principals . Teachers routinely receive data on student achievement as 
they watch their students in class, review their assignments, and grade 
classroom tests. These data are immediate, rich, and compelling. So too 
is the information principals regularly gather as they talk with staff and 
visit their classrooms. To be as useful and as compelling, external test 
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Information must add "something new" to what teachers and principals 
already know. Each of the four models described above did this. Central 
City's computer-scoring-and-analysis system for unit tests summarized indi- 
vidual students' mastery of objectives, as well as their errors and weak- 
nesses. Shelter Grove compiled data on the progress of individuals and 
instructional groupings toward benchmark goals. St. John's Academic Per- 
formance Profiles charted year-to-year trends and annual gains. Bayview's 
task analysis projects, based on tested skills and test scores, helped to 
reveal why and how students' performance came to be as it was. In each 
case, test data was configured in ways that told teachers and principals 
something more than "your students are doing well in this and not so well 
in that" which is" information teachers and principals typically feel 
they already have. 

A fourth and final element in successful district linkage is the 
maintenance of on-going resource and support systems . In the districts 
studied, these centered in the area of staff development: training in test 
development and use, training in how to realize instructional goals derived 
from test information, or both. Frequently, too, instructional support 
staff -- learning specialists, media specialists, evaluation specialists — 
were routinely available to provide help and answer questions. Support 
also took the form of adaptability and flexibility on the part of district 
administrators. Clear channels were open for Central City and Shelter 
Grove teachers to participate in the development of, and to criticize the 
quality of district curriculum and tests. St. John's evaluation special- 
ists revised district needs-assessment surveys in light of teachers' feed- 
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back; local schools could add survey Items suitable to their particular 
concerns. Bayvlew district leaders showed patience and understanding In 
encouraging principals and teachers to take a "problem-solving approach" to 
low test scpres. And of course, each district supported its testing- 
Instructional linkage system with release time and other resources. 

The models and guidelines suggested here will not answer all the ques- 
tions and concerns school districts will encounter as they work 
systematically to link testing and instruction in an on-going process of 
school renewal. But they do Indicate productive paths toward the more 
efficient use of testing and the Improvement of educational planning in 
American schools. 
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